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Abstract. This article presents a methodology that automatically derives a combinatorial spec¬ 
ification for a permutation class C, given its basis B of excluded patterns and the set of simple 
permutations in C, when these sets are both finite. This is achieved considering both pattern avoid¬ 
ance and pattern containment constraints in permutations. The obtained specification yields a 
system of equations satisfied by the generating function of C, this system being always positive and 
algebraic. It also yields a uniform random sampler of permutations in C. The method presented is 
fully algorithmic. 
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1. Introduction 


Permutation classes (and the underlying pattern order on permutations) were defined in the sev¬ 
enties, and since then the enumeration of specific permutation classes (z.e., sets of permutations 
closed under taking patterns) has received a lot of attention. In this context, as in many in combi¬ 
natorics, a recursive description of the permutations belonging to the class is often the key towards 
their enumeration. This recursive description is a priori specific to the class studied. But more 
recently, the substitution decomposition (along with other general frameworks, see |Vatl51 and ref¬ 
erences therein]) has been introduced for the study of permutation classes: it provides a general and 
systematic approach to their study, with a recursive point of view. This tool has already proved 
useful in solving many enumerative problems |AAn5| lAABll) lABld) IASV12| among others], but 
also in other areas like algorithmics [BBCPOTl IBR.Ob] . 

The goal of the current paper is to systematize even more the use of substitution decomposition 
for describing recursively and enumerating permutation classes. Our main result is an algorithm 
that computes a combinatorial specification (in the sense of Flajolet and Sedgewick [FSn9j l for 
any permutation class containing finitely many simple permutations. Note that this problem has 
been addressed already in |AA051 IBHVOSj . however with much less focus on the algorithmic side. 
Moreover, we introduce in this article a generalization of permutation classes that we call restrictions: 
while every permutation class is characterized by a set of forbidden patterns, a restriction is described 
giving a set of forbidden patterns and a set of mandatory patterns. Our algorithm also allows to 
compute a specification for restrictions containing finitely many simple permutations. 

The article is organized as follows. We start by recalling the necessary background in Section]^ 
permutation classes, substitution decomposition, and the symbolic method. Section gives a more 
detailed presentation of our results. Here, we dedicate specific attention to explaining the differences 
between our work and those of | A AOS I IBHV08| , and to putting our result in a more global algorithmic 
context (namely, we describe an algorithmic chain from the basis H of a class C to random sampling 
of permutations in C). With the next sections, we enter the technical part of our work. After 
briefly solving the case of substitution-closed classes in Section we explain in two steps how to 
obtain a combinatorial specification for other classes C. Section gives an algorithm producing an 
ambiguous system of combinatorial equations describing C. Next, Section describes how to adapt 
this algorithm to obtain a combinatorial specification for C. Finally, Section illustrates the whole 
process on examples. 

2. Some background on permutations and combinatorial specifications 

2.1. Permutation patterns and permutation classes. A permutation a of size |cj| = n is 
a bijective map from [l..n] = {l,...,n} to itself. We represent a permutation by a word a = 
criCJ 2 ... (Tn, where each letter Uj denotes the image of i under a. We denote £ the only permutation 
of size 0; e is also called the empty permutation. 

Definition 2.1. For any sequence s of k distinct integers, the normalization of s is the permutation 
TT of size k which is order-isomorphic to s, i.e., S£ < Sm whenever ng < Tim- 

For any permutation a of size n, and any subset I = {ii ,..., of {1 ,..., n} with ii < ... < i^, 
ai denotes the permutation of size k obtained by normalization of the sequence . 

Definition 2.2. A permutation tt is a pattern of a permutation a if and only if there exists a subset 
I of {1,..., |it|} such that aj = vr. We also say that a contains or involves n, and we write tt ^ a. 
A permutation a that does not contain n as a pattern is said to avoid vr. 

Example 2.3. The permutation a = 316452 contains the pattern 2431 whose occurrences are 3642 
and 3652. But a avoids the pattern 2413 as none of its subsequences of length 4 is order-isomorphic 
to 2413. 


2 























The pattern containment relation ^ is a partial order on permutations, and permutation classes 
are downsets under this order. In other words: 

Definition 2.4. A set C of permutations is a permutation class if and only if for any a € C, if 
TT ^ a, then we also have ir £ C. 

Throughout this article, we take the convention that a permutation class only contains permuta¬ 
tions of size n > 1, i.e., e for any permutation class C. 

Every permutation class C can be characterized by a unique antichain B {i.e., a unique set of 
pairwise incomparable elements) such that a permutation a belongs to C if and only if it avoids 
every pattern in B (see for example jAAOS]). The antichain B is called the basis of C, and we write 
C = Av{B). The basis of a class C may be finite or infinite; it is described as the permutations that 
do not belong to C and that are minimal in the sense of ^ for this criterion. 


2.2. Simple permutations and substitution decomposition of permutations. The descrip¬ 
tion of permutations in the framework of constructible structures (see Section 2.3) that will be used 
in this article relies on the substitution decomposition of permutations. Substitution decomposition 
is a general method, adapted to various families of discrete objects |MR84j . that is based on core 
items and relations, and in which every object can be recursively decomposed into core objects using 
relations. In the case of permutations, the core elements are simple permutations and the relations 
are substitutions. 


Definition 2.5. An interval of a permutation a of size n is a non-empty subset {i,..., (i i — 1)} 
of consecutive integers of {1,... ,n} whose images by a also form a set of consecutive integers. The 
trivial intervals of a are {!},..., {n} and {1,..., n}. The other intervals of a are called proper. 

Definition 2.6. A block (resp. normalized blockj of a permutation a is any sequence 
(resp. any permutation aj) for I = {ii ,..., im} an interval of a. 

Definition 2.7. A permutation a is simple when it is of size at least 4 and it contains no interval, 
except the trivial ones. 

Note that no permutation of size 3 has only trivial intervals (so that the condition on the size is 
equivalent to “at least 3”). 

Remark 2.8. The permutations 1, 12 and 21 also have only trivial intervals, and are considered 
simple in many articles. Nevertheless, for our notational convenience in this work, we prefer to 
consider that they are not simple. 

For a detailed study of simple permutations, in particular from an enmuerative point of view, 
we refer the reader to |AAn5[ IAAKn3l IBrilO] . Let us only mention that the number of simple 
permutations of size n is asymptotically equivalent to ^ as n grows. 

Let (T be a permutation of size n and ..., vr” be n permutations of size pi,... ,pn respectively. 
Define the substitution cr[7r^, vr^,..., vr”] of vr^,..., tt"' in cr (also called inflation in |AAn5j l to be 
the permutation obtained by concatenation of n sequences of integers S^,..., from left to right, 
such that for every i,j, the integers of S'* form a block, are ordered in a sequence order-isomorphic 
to vr*, and S* consists of integers smaller than if and only if cTj < aj. The interested reader 
may find a formal definition in |Piel3| Definition 0.25]. When a permutation r may be written as 
r = cT[7r^, TT^, ..., vr"], we also say that cr[7r^, vr^,..., vr"'] provides a block decomposition of r. 

Example 2.9. The substitution 1 32[2 1,132,1] gives the permutation 21 465 3. In particular, 
1 3 2[2 1,1 3 2,1] is a block decomposition o/ 2 1 4 6 5 3. 
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When substituting in a = 12 or 21, we often use © (resp. 0) to denote the permutation 12 (resp. 

21 ). 

Definition 2.10. A permutation vr is ©-indecomposable (resp. ©-indecomposable^ if it cannot be 
written as©[7r^,7r^] (resp. ©[7r^,7r^]J. 

Simple permutations, together with © and ©, are enough to describe all permutations through 
their substitution decomposition: 

Theorem 2.11 (Proposition 2 of |AA05| 1. Every permutation vr of size n with n >2 can be uniquely 
decomposed as either: 

• ©[7r^,7r^], with TT^ ©-indecomposable, 

• ©[7r^,7r^], with TT^ Q-indecomposable, 

• (T[7r^, vr^,..., vr*^] with a a simple permutation of size k. 


Remark 2.12. The simple permutation a in the third item of Theorem 2.11 is a pattern of the 
permutation vr. Hence, as soon as vr belongs to some permutation class C, then so does a. 


Theorem |2 .11 1 provides the first step in the decomposition of a permutation vr. To obtain its full 
decomposition, we can recursively decompose the permutations tt* in the same fashion, until we 
reach permutations of size 1. This recursive decomposition can naturally be represented by a tree, 
that is called the substitution decomposition tree (or decomposition tree for short) of vr. 


Definition 2.13. The substitution decomposition tree T of a permutation vr is the unique ordered 
tree encoding the substitution decomposition ofir, where each internal node is either labeled by ©,© 
- those nodes are called linear - or by a simple permutation a - prime nodes. 


Note that in decomposition trees, linear nodes are always binary, and the left child of a node 
labeled by © (resp. ©) may not be labeled © (resp. ©), since vr^ is ©-indecomposable (resp. ©- 


indecomposable) in the first (resp. second) item of Theorem 2.11 


Example 2.14. The permutation vr = 6 9 8 7311541017121416131512 can be recursively de¬ 
composed as 


vr = 2413[476519328,1,12,35241] 

= 2413[31524[©[1, ©[1, ©[1,1]]], 1, !,©[!, 1], 1]], 1, ©[1,1], ©[2413[1,1,1,1], Ij] 
and its decomposition tree is given in Figure^ 



Figure 1. Decomposition tree of vr = 6 9 8 7 3 11 5 4 10 17 1 2 14 16 13 15 12. 
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Definition 2.15. The substitution closure C of a permutation class C is defined as Uk>iC^ where 
= C and = {(t['k^ ,..., ■n'^] | a G C and vr* G for any i from 1 to n = |cr|}. 

Because simple permutations contain no proper intervals, we have: 

Remark 2.16. For any class C, the simple permutations in C are exactly the simple permutations 
in C. 


Consequently, for any permutation class C, this allows to describe C as the class of all permutations 
whose decomposition trees can be built on the set of nodes {©,©} U ^c, where Sc denotes the set 
of simple permutations in C (if 12 and 21 belong to C; otherwise we have to remove © or © from 
the set of nodes). 

Definition 2.17. A permutation class C is substitution-closed ifC = C, or equivalently if for every 
permutation a of C, and every permutations vr^, tt^, ..., vr" of C (with n = \(t\), the permutation 
cj[7r^, vr^,..., tt”] also belongs to C. 

Like before, a substitution-closed permutation class can therefore be seen as the set of decompo¬ 
sition trees built on the set of nodes {©, ©} U^c (if 12 and 21 belong to C; but otherwise C is trivial 
and has at most one permutation of each size). 

Remark 2.18. In |AA05| . it is proven that substitution-closed permutation classes can be char¬ 
acterized as the permutation classes Av{B) whose basis B contains only simple permutations (or 
maybe 12 or 21 for trivial classes). 


2.3. From combinatorial specifications to generating functions and random samplers. 

Let us leave aside permutations for now, and review some basics of the symbolic method about 
constructible structures and their description by combinatorial specifications. We will see in Theo¬ 
rem 


6.4 (p, 251 that the classes of permutations we are interested in fit in this general framework. 


A class C of combinatorial structures is a set of discrete objects equipped with a notion of size: 
the size is a function of C —?• N denoted | • | such that for any n the number of objects of size n in C 
is finite. 

Among the combinatorial structures, we focus on constructible ones, from the framework intro¬ 
duced in |FSn9) . Basically, a constructible combinatorial class is a set of structures that can be 
defined from atomic structures of size 1 (denoted by Z)., possibly structures of size 0 (denoted by 
T), and assembled by means of admissible constructors. While a complete list of these combinatorial 
constructors is given in |FSn9) . we only use a (small) subset of them: the disjoint union, denoted 
by © or + (we may also use the notation ^), to choose between structures; and the Cartesian 
product, denoted by x, to form pairs of structures. More formally, a constructible combinatorial 
class is one that admits a combinatorial specification. 


Definition 2.19. A combinatorial specification for a combinatorial class Ci is an equation or a 
system of equations of the form 

Cl = Z,Ci,C2, ■ ■ ■ ,Cm), 

C 2 = 'H2{£, Z,Ci,C2, ■ ■ ■ ,Cm), 

< 

Cm = Bm{£iZ,Ci,C2,- ■ ■ ,Cm)j 

where each %i denotes a term built from Ci,... ,Cm,Z and £ using admissible constructors. 


For example, the equation X = £ -\- Z xX describes a class X whose elements are finite sequences 
of atoms. 
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In this framework, the size of a combinatorial strnctnre is its nnmber of atoms {Z) and from 
there, combinatorial strnctnres can be connted according to their size. The size information for 
a whole combinatorial class, say C, is encoded by its ordinary generating functiot^ which is the 
formal power series C{z) = Yln>o where the coefficient Cn is the nnmber of strnctnres of size n 
in C. Note that we also have C{z) = 

Combinatorial specifications of combinatorial classes may be antomatically translated into sys¬ 
tems defining their generating fnnction (possibly implicitly). This system is obtained by means of a 
dictionary that associates an operator on generating fnnctions to each admissible constrnctor. The 
complete dictionary is given in |FS09) . together with the proof that this translation from constrnc- 
tors of combinatorial classes to operators on their generating fnnctions is correct. Here, we only 
nse the constrnctors disjoint union and Cartesian prodnct, which are respectively translated to snm 
and prodnct of generating fnnctions. 

A lot of information can be extracted from snch fnnctional systems; in particnlar, one can compnte 
as many coefficients of the series as reqnired, and |FS09| provides many tools to get asymptotic 
eqnivalents for these coefficients. 

Combinatorial specifications may also be antomatically translated into nniform random samplers 
of objects in the class described by the specification. Indeed, a specification can be seen as a 
(recnrsive) procednre to prodnce combinatorial objects, and randomizing the choices made dnring 
this procednre transforms the specification into a random sampler. To ensnre that snch random 
samplers are nniform [i.e. that for any n, two objects of the same size n have the same probability 
of being prodnced), two methods have been developed: the recnrsive method |FZVC94] and the 
Boltzmann method |DFLSn4j . In the first one, the coefficients of the generating fnnctions are nsed 
for the probabilistic choices to ensnre uniformity, making this method well-adapted for generating 
a large sample of objects of relatively small size: this reqnires to compnte only once a relatively 
small nnmber of coefficients. The focns of the second one is to achieve efficiently the generation of 
very large objects, with a small tolerance (of a few percents) allowed on their size. Coefficients of 
the generating fnnctions are not needed in Boltzmann samplers, bnt rather the generating fnnctions 
themselves. More precisely, the valne of the generating fnnction at a given point needs to be 
compnted, and this is solved in |PSS12) . 

3. Our results in existing context 

3.1. Our contributions, and comparison with |AA05llBHV08] . The goal of the present work is 
to solve algorithmically a combinatorial problem on permntation classes: compnting in an antomatic 
way a combinatorial specification for any given class, nnder some conditions specified below. We 
first have to determine how to describe the permntation class C in inpnt. In all what follows, 
we will snppose that C is given by its basis B of exclnded patterns and the set Sc of simple 
permntations in C, assnming that both these sets are finite. Note that from |AA05I Theorem 9] the 
basis of C is necessarily finite when C contains finitely many simple permntations. On the other 
hand, from |BRV081 IBBPR15] . it is enongh to know B to decide whether Sc is finite and (in the 
affirmative) to compnte Sc |PR12j . 

Onr work is a continnation of the main resnlt (Theorem 10) of jAAOS]: every permntation 
class containing finitely many simples has an algebraic generating fnnction. The main step in 
the proof of this resnlt is to constrnct a system of combinatorial eqnations describing C nsing the 
snbstitntion decomposition, and more precisely by propagation of pattern avoidance constraints in 

^We do not use exponential but ordinary generating functions to count pattern-avoiding permutations. First, note 
that the corresponding exponential generating functions would have Infinite radii of convergence, pattern-avoiding 
permutations of size n being always less than c" for some constant c |MT04| . The use of ordinary generating functions 
is moreover very natural since our work is based on an encoding of permutations by trees built on a finite set of nodes. 
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the decomposition trees. Although the proof is in essence constructive, there is still some work to 
be done to fully automatize this process. In Section we review their method, going deeper in 
the details of the construction. This allows us to bring their methodology to a full algorithm - see 
Algorithm AmbiguousSystem (pj^ and Theorem [ST] (pflij) . 

It is important to note that the description of C obtained in this way is not a combinatorial 
specification, since it is a priori ambiguous (that is to say, unions are not necessarily disjoint). 
Nevertheless, as it is done in jAAOS], this ambiguous system can be used for proving the algebraicity 
of the generating function of C, and even allows its computation (or implicit determination, in 
less favorable cases): it is enough to apply the inclusion-exclusion principle. The advantage of a 
specification over an ambiguous system will be discussed in Section 3.2 (fifth step, pTO). 


The algebraicity result of |AA05) was re-proved in |BHV08) and extended to generating functions 
of some subsets of classes C with finitely many simples: the alternating permutations in C, the 
even ones, the involutions in C,... For our purpose, those extensions are less important than the 
alternative proof of the main result of |AA05| : indeed, this second proof describes a method to build 
a combinatorial specification for C. Essential to this proof are query-complete sets, whose definition 
we recall. 


Definition 3.1. A property is any set P of permutations. A permutation vr is said to satisfy P 
when TT € P. A set V of properties is query-complete if, for every simple permutation a (and also 
for cj = © or Q) and for every property P € V, it can be decided whether cr[ai ,..., ai^i] satisfies P 
knowing only which properties ofV are satisfied by each at. 

The proof of the main result (Theorem 1.1) of |BHV08| shows that a combinatorial specification 
for a permutation class C with finitely many simples can be obtained from any finite query-complete 
set V such that C £ V. More precisely, this combinatorial specification consists of three types of 
equations, described below (this is reduced to two types by plugging the third one into the second 
one). Recall that Sc denotes the set of simple permutations in C. Note that all unions below are 
finite, since V and Sc are finite by assumption. 

• First, C is written as the disjoint union 

C = ©Ca’, 

where the union runs over all subsets A! oi V containing C with Cx denoting the set of 
permutations that satisfy every property in A and do not satisfy any property mVfX. 

• Second, for any such set X, the substitution decomposition allows to write 

Ca' = 1y © © y Cx 

a£Sc 

where lx is either the set {1} if the permutation 1 belongs to Cx, or the empty set otherwise, 
and where is the subset of Cx of permutations whose decomposition tree has root a. 

• And third, for a G {©, 0} U^c and X as above, the fact that V is query-complete allows to 
express CJ as 

Cx = 1+J<^[Cyi, ■ • ■,Cx,^] 

where the union is over the set Ex,a of all m-uples (Ai,..., Xm) of subsets of V such that 
if, for every i G [l..m], it holds that ccj G Cx^ then ..., am] G Cx- In the case where 
(7 = © (resp. ©), to ensure uniqueness of the decomposition, we further need to enforce that 
Ai contains the property of being ©-indecomposable (resp. ©-indecomposable). W.l.o.g., 
we can assume that these properties are in P. 

Note that the number of equations in the specification obtained depends exponentially on the size 
of P, since there is at least one equation for each subset of P containing C. Similarly, the number 
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of terms of the union defining some CJ may be exponential in the size of "P, since the union is over 
m-uples of subsets of V (with m = |(t|). 

We point out that the above specihcation is not fully explicit (even assuming that V is given), 
since there is no explicit description of the sets Ex,a- As explained in the proof of Lemma 2.1 
of |BHVn8) . the sets Ex,a may be described using so-called lenient inflations, which are intimately 
linked with the embeddings by blocks of |AAn5| . But neither |BHVn8) nor |AAn5) discuss their 
effective computation. We will return to this problem later in this section. 

For any permutation class C = Av{B) with hnitely many simples, the authors of [BHVn8) provide 
a hnite query-complete set that contains C, and conclude that there is a combinatorial specihcation 
for any such C. More precisely, the class C being described as r]g£BAv{/3), they rather consider 
separately every principal class Av{j3) for all /d £ B, and dehne a hnite query-complete set Vg 
containing it. This is essentially their Lemma 2.1. The query complete set associated with C, 
denoted Vc, is then obtained taking the union of all Vg. It consists of the following properties: 
the set of ©-indecomposable permutations, the set of ©-indecomposable permutations, and the set 
Av{p) for every permutation p which is a pattern of some (5 £ B. Thus Vc is often a big set. 

It should be noticed that the query-complete sets that are used in the examples of |BHV08l 
Section 4] are however strictly included in the set Vc- These smaller query-complete sets are better, 
since they result in specihcations with fewer equations and unions having fewer terms than the ones 
that would be obtained applying to the letter the specializations of the proofs. But there are no 
indications in |BHV08j on how these smaller query-complete sets were computed, nor on how this 
could generalize to other examples. It should be noticed that in the examples of |BHV08) . the class 
is either substitution-closed, or contains no simple permutations. 

To summarize, the proof of the main result of |BHV08) gives a general method to compute a 
specihcation for a permutation class having hnitely many simple permutations. But there is still 
some work to be done to fully automatize this process, and the specihcation obtained would be very 
big in general. Moreover, an algorithm using this method would have a lot of computations to do 
(the computation of all the sets Ex,a)- On the other hand, the ad hoc constructions of the examples 
of |BHV08) show that using the specihcity of a particular permutation class, it is possible to obtain 
shorter specihcations with fewer computations. 


Our main contribution is to give an algorithm to compute a specihcation for any permutation 
class having hnitely many simples, using a different approach - see Algorithm SPECIFICATION (pj23|) 
and Theorem |^(p@. Our method is general (unlike the ad hoc methods used in the examples 
of |BHV08] 1 but nevertheless uses the specihcity of the permutation class given in input (unlike the 
method described in the proofs of |BHV08] 1 in order to do less computations and to have fewer 
equations in the specihcation. 

Even if the method we use and the specihcation we produce are not exactly the ones presented 
by |BHV08) and reviewed above, they have some similarities. When considering the partition of 
C into £lCx shown above, |BHV08) is looking at a very hne level of details, where a coarser level 
could be enough. With our method, we consider the partition of C which is the coarsest possible to 
allow the derivation of a specihcation. In practice, if two sets A and X' are such that Cx and Cx' 
appear as Cx W Ca' everywhere in the specihcation resulting from |BHVn8| , our specihcation will 
have only one term instead of these two, representing Cx W Ca'- Of course, this holds for unions 
with more terms as well. Considering fewer sets A results in fewer equations in the specihcation, 
fewer terms in the unions and fewer sets Ex,a- Since the computation of the Ex,a amounts to 
computing the specihcation from the query-complete set, the algorithmic complexity for computing 
the specihcation with our method is hereby reduced, compared to what a formalized algorithm of 
the approach of |BHVn8) would give. 


































Concretely, our algorithm computes a query-complete set, the sets -Ea’.o- associated, and the 
specihcation in parallel, whereas the method of |BHV08| is to hrst compute a query-complete set 
and then deduce a specihcation. Note that in our presentation, the result of our algorithm is only 
the specihcation, but it contains also implicitly the description of the query-complete set and of the 
Ex,a- 

To obtain the announced coarsest partition of C, and the subsequent specihcation with as few 
equations as possible that it yields, we proceed as follows. We use the same guideline as in |AAn5) for 
computing a possibly ambiguous combinatorial system describing C (however making this approach 
effective): the essential idea is to use the substitution decomposition and to propagate pattern 
avoidance constraints in the decomposition trees. We get rid of the ambiguity by introducing 
complement sets, but only when they are needed (the method in the proofs of |BHVn8) can be 
seen as somehow introducing all complement sets at once). In practice, it means that we are not 
only propagating avoidance constraints in decomposition trees, but also containment constraints. 
It will be clear in Sections and that even though the purposes of those two types of constraint 
are opposite, the ways to propagate them are very similar, an essential step being the effective 
computation of the embeddings/lenient inflations mentioned in |AA05l IBHV08] . The method used 
to explicitly determine which avoidance/containment constraints are necessary and to effectively 
propagate them in the trees is completely new with respect to |AA051 IBHV08] . 

To conclude on our contributions compared with those of |AA05[ IBHV08] . our work describes 
how to obtain a combinatorial specihcation for any class having hnitely many simple permutations. 
Contrary to |AA051[BHV08| . our work is fully algorithmic. Moreover, we develop a method allowing 
to have fewer equations in the specihcation and to have a better efficiency compared to what a 
formalized algorithm of the approach of |BHV08] would give. 

3.2. An algorithmic chain from B to random permutations in Av{B). Our main result (that 
is, the algorithmic computation of specihcations for permutation classes with hnitely many simples) 
can and should be viewed in the context of other recent algorithms from the literature. Together, 
they provide a full algorithmic chain starting with the hnite basis B oi a permutation class C, and 
computing a specihcation for C, from which it is possible to sample permutations in C uniformly at 
random. Figure shows an overview of this algorithmic chain, and we present its main steps below. 
Note that this procedure may fail to compute its hnal result, namely when C contains an inhnite 
number of simple permutations, this condition being tested algorithmically. 

We have chosen that the permutation class in input of our procedure should be given by its 
basis B, that we require to be hnite. This does not cover the whole range of permutation classes, 
but it is one of the possible ways to give a hnite input to our algorithm. There are of course other 
hnite descriptions of permutation classes, even of some with inhnite basis (by a recognition procedure 
for example). The assumption of the description by a hnite basis has been preferred for two reasons: 
hrst, it encompasses most of the permutation classes that have been studied; and second, it is a 
necessary condition for classes to contain hnitely many simple permutations (see |AA051 Theorem 
9]) and hence for our algorithm to succeed. 

First step: Finite number of simple permutations. 

First, we check whether C = Av{B) contains only a hnite number of simple permutations. This 
is achieved using algorithms of |BBPR10| when the class is substitution-closed and of jBBPRlS] 
otherwise. The complexity of these algorithms is respectively O(nlogn) and 0{n\ogn+p^^), where 
n = E/3eB l/^l’ P = max{|/3| : /3 e R} and A: = |R|. 

Second step: Computing simple permutations. 

The second step of the algorithm is the computation of the set of simple permutations Sq contained 
in C = Av{B), when we know it is hnite. Again, when C is substitution-closed. Sc can be computed 
by an algorithm that is more efficient than in the general case. The two algorithms are described 
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Figure 2. The full algorithmic chain starting from the basis 5 of a permutation 
class C, with complexities given w.r.t. n = Ylp&B l/^l) ^ = l-^l) P = max{|/3| : /3 G -B}, 
N = |5c| and t = max{|7r| : vr G 5c} where 5c is the set of simple permutations of C. 


in |PRT2], and their complexity depends on the output: 0{N ■ • k) in general and 0{N ■ 

for substitution-closed classes, with N = |5c|, p = max{|/3| : (5 G B}, ^ = max{|7r| : vr G 5c} and 


k = \B 


In the case of substitution-closed classes, the set of simple permutations in C gives an immediate 
access to a specihcation for C - see |AAn5) or Theorem 4.3 (pT3). In the general case, hnding such 
a specihcation is the algorithmic problem that we address in this article. 


Third step: Computing a combinatorial specification. 

This corresponds to the computation of a combinatorial specihcation for C by propagation of pattern 
constraints and disambiguation of the equations, as briehy presented in Section 3.1 and described 
in details in Sections |5] and [HI 


From a combinatorial specihcation for C, that we may obtain algorithmically as described above, 
there are two natural algorithmic continuations (which we have reviewed in Section 2.3): 


Fourth step: Computing the generating function C{z) of C. 

With the dictionary of [FSOhj . a system of equations dehning C{z) = immediately 

deduced from the specihcation. Because our specihcation involves only disjoint unions and Cartesian 
products, the resulting system is positive and algebraic. In some favorable cases, this system may 
be solved for C(z) explicitly. Even if it is not the case, many information may still be derived from 
the system, in particular about the coefficients c„ or the growth rate of the class. 


An alternative for the computation of C{z). 

As explained in |AAn5) and reviewed earlier in this paper, it is also possible to obtain such a system 
of equations for C{z) from an ambiguous system describing C, applying the inclusion-exclusion 
principle. In this case, the obtained system is algebraic but with negative terms in general. 


Fifth step: Random sampling of permutations in C. 

In Section 2.3 we have reviewed the principles that allow, in the same fashion as the dictionary 
of |FSn9) . to translate the combinatorial specihcation for C into uniform random samplers of per¬ 
mutations in C. Remark that this translation is possible only with a specihcation, i.e. a positive 
unambiguous system describing C. Indeed, whereas adapted when considering generating functions 
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(where subtraction is easily handled), the inclusion-exclusion principle cannot be applied for random 
generation (since “subtracting combinatorial objects” is not an option in a procedure to produce 
them). 

To illustrate that this algorithmic chain is effective, we present in Section how our algorithms 
run on examples. We also show some observations that are produced through it in Figures]^ and 
below. These hgures have been obtained with a prototype implementing our algorithms, that we 
hope to make available for use by others in the futur^ 



Figure 3. The shape of permutations in the (not substitution-closed) class C of Section [7(2 


Figure shows the “average diagram” of a permutation in the class C (not substitution-closed) 
studied in Section 7.2 (p,34). The diagram of a permutation a is the set of points in the plane at 
coordinates {i,ai), and the picture in Figure]^ is obtained by drawing uniformly at random 30 000 
permutations of size 500 in C, and by overlapping their diagrams - the darker a point (x, y) is, the 
more of these permutations have (t{x) = y. 




Figure 4. The shape of separable permutations (left), and of permutations taken in 
the substitution-closed class whose set of simple permutations is {2413, 3142, 24153} 

(right). 

Figurej^shows average diagrams of permutations in the (substitution-closed) class j4u( 2413, 3142) 
of separable permutations, and in another substitution-closed class. These diagrams are obtained 

Boltzmann sampler for substitution-closed classes is already available here: http://igm.univ-mlv.fr/ 
'pivoteau/Permutations/, The implementation is in Maple, an example of use is given in the worksheet. 
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overlapping the diagrams of 10 000 permutations of size 100 (resp. 500). The representation is 
however a little different from Figure in these 3D representations, for a point at coordinates 
{x,y,z), z is the number of permutations such that cr(x) = y. Leaving aside the difference in the 
representation, these figures suggest a very different limit behavior in substitution-closed and not 
substitution-closed classes. 

Looking at these diagrams, a natural question is then to describe the average shape of permuta¬ 
tions in classes. This is a question which has received quite a lot of attention lately, especially for 
classes Av{t) for r of size 3, see |AM141 IHRS14| IMP14a| IMP14b] . Inspired by Figure]^ some of us 
(in collaboration with V. Feray and L. Gerin) have described the limit shape of separable permu¬ 
tations in |BBFGP16) . thus explaining the first diagram of Figure]^ As we discuss in |BBFGP16] . 
we are working on generalizing this result to substitution-closed classes, which would also explain 
the second diagram of Figure]^ 

3.3. Perspectives. As described in Section [3.2[ our main result combines with previous works to 
yield an algorithm that produces, for any class Av{B) containing finitely many simple permutations, 
a recursive (resp. Boltzmann) uniform random sampler. When generating permutations with such 
samplers, complexity is measured w.r.t. the size of the permutation produced and is quasilinear 
(resp. quadratic but can be made linear using classical tricks and allowing a small variation on 
the size of the output permutation |DFLS04j L However, the complexity is not at all measured 
w.r.t. the number of equations in the specification nor w.r.t. the number of terms in each equation. 
In our context, where the specifications are produced automatically, and potentially contain a large 
number of equations/terms, this dependency is of course relevant, and opens a new direction in the 
study of random samplers. 

In addition to providing inspiration for the study of random permutations, our algorithmic chain 
has other applications. Indeed, the specifications obtained could also be used to compute or estimate 
growth rates of permutation classes. Moreover, the computed specifications could possibly be used 
to provide more efficient algorithms to test membership of a permutation to a class. 

We should also mention that our procedure fails to be completely general. Although the method 
is generic and algorithmic, the classes that are fully handled by the algorithmic process are those 
containing a finite number of simple permutations. From |AA05) . such classes are finitely based. 
And since there are countably many such permutation classes, only a very small subset of the 
(uncountably many) permutation classes is covered by our method. 

But note that even if a class C contains an infinite number of simple permutations, we can (at 
least in theory) use our approach to perform random generation of permutations of the class C. 
More precisely, fixing the maximum size n of permutations we want to generate, we can apply our 
algorithm to a class C' C C containing finitely many simple permutations and that coincides with C 
up to size n. It is enough to choose C which is the subclass of C whose set of simple permutations 
consists in all simple permutations of C of size at most n, whose computation is explained in |PR12) . 
If the maximal size n is large and if C has many simple permutations of each size, it is likely that 
the complexity of our algorithm will be too large for it to be of any use. But this approach may be 
relevant when the class has an infinite number of simple permutations, but a small number of each 
size. 

To enlarge the framework of application of our algorithm computing specifications, we could ex¬ 
plore the possibility of extending it to permutation classes that contain an infinite number of simple 
permutations, but that are finitely described. A family of such classes is considered in |ARV15] . 
where the finite basis and algebraicity results of |AAn5j are extended from classes with finitely 
many simple permutations to subclasses of substitution closures of geometrically griddable classes 
(we refer the reader to |ARV15) for definitions). The proofs in |ARV15) involve similar techniques as 
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in |BHV08j (including query-complete sets), but not only. In particular, they heavily rely on the re¬ 
sults of |AABRV13| . which are non-constructive. Making all the process in |AABRV13) and |ARV15| 
constructive, and then turning it into an effective procedure, it may be possible to extend our al¬ 
gorithms to all classes considered in |ARV15| . But this is far from straightforward, and beyond 
the scope of the present work. Note that, with such an improvement, more classes would enter our 
framework, but it would be hard to leave the algebraic case. 


4. Combinatorial specification of substitution-closed classes 


In this section, we recall how to obtain a combinatorial specification for substitution-closed classes 
having finitely many simple permutations. 

Recall that we denote by C the substitution closure of the permutation class C, and that C is 
substitution-closed when C = C, or equivalently when the permutations in C are exactly the ones 
whose decomposition trees have internal nodes labeled by ©, © or any simple permutation of C. 

For the purpose of this article, we additionally introduce the following notation: 


Definition 4.1. For any set A of permutations, (resp. A ) denotes the set of permutations of A 
that are Q)-indecomposable (resp. Q-indecomposable) and 5^ denotes the set of simple permutations 
of A. 

Theorem 2.11| (pQ directly yields the following proposition: 

Proposition 4.2 (Lemma 11 of jAAOH]). Let C = C be a substitution-closed c/as.0 Then C satisfies 
the following system of equations, denoted 

(1) C = 1 © ©[C+,C] © ©[C-,C] ©[±),g5^7r[C,...,C] 

(2) C+ = 1 © e[C-,C] © l±J. 65 ,vr[C,...,C] 

(3) C- = 1 © ©[C+,C] © [±),g5^7r[C,...,C]. 

Note that by Remark |2.16[ Sc = 5^. By uniqueness of the substitution decomposition, unions are 
disjoint and so Equations Q to (|^ describe unambiguously the substitution-closed class C. Hence, 
Proposition 4.2 can be transposed in the framework of constructible structures as follows: 


Theorem 4.3. Let C be a substitution-closed class. Then C can be described as a constructible 
combinatorial class in the sense of Section \2.3\ with the following combinatorial specification, where 
the Ett for vr in Sc are distinct objects of size oj^ 

'C = Z -\- X C+ X C + Eq X C~ X C + Sn x C x ■ ■ ■ x C 

kl 

^ C~^ = Z Eq X C xC + X^ttS^c ^ C X ■ — X 

kl 

C = Z A Eq X C~*~ X C + XyTrSiSc ^ C X ■ y X C . 


Moreover this system can be translated into an equation for the generating function C{z): 

Proposition 4.4 (Theorem 12 of jAAOS]). Let C be a substitution-closed class, with generating 
function C{z). Then 

C{zf + {Sc{C{z)) - 1 + z)C(z) + Sc(C(z)) + z = 0 

^that contains 12 and 21; it will be the case until the end of the article and will not be recalled again. 

^The are introduced only to distinguish between substitutions in distinct n of the same size. The term 
X C X ■■■ X C then corresponds to the classical substitution operation: 7r[C, ■ • ■ ,C] 

13 



























with Sc{z) denoting the generating funetion that enumerate simple permutations in C, i.e. Sc{z) = 
2-^'k^Sc ^ 


Hence, in the case of a substitution-closed class C (and for the substitution closure C of any class), 
the system that recursively describes the permutations in C can be immediately deduced from 
the set Sc of simple permutations in C. As soon as Sq is finite and known, this system is explicit 
and gives a combinatorial specification. 

Our next goal is to describe an algorithm that computes a combinatorial system of equations for 
a general permutation class C from the simple permutations in C, like for the case of substitution- 
closed classes. However, when the class is not substitution-closed, this is not as straightforward as 
what we have seen in Proposition 4.2 and we provide details on how to solve this general case in 
the following sections. 


5. A POSSIBLY AMBIGUOUS COMBINATORIAL SYSTEM FOR PERMUTATION CLASSES 


In this section, we explain how to derive a system of equations for a class C with finitely many 
simple permutations from the combinatorial specification of its substitution closure. Our method 
follows the guideline of the constructive proof of |AAn51 Theorem 10]. However, unlike [AA05], we 
make the whole process fully algorithmic. 

The key idea of the method is to describe recursively the permutations in C, replacing the con¬ 
straint of avoiding the elements of the basis by constraints in the subtrees of the decomposition 
tree of permutations in C. This is done by computing the embeddings of non-simple permutations 
7 of the basi^ B oi C into simple permutations tt belonging to the class C (and into © and 0 ). 
These embeddings are block decompositions of the permutations 7 , each (normalized) block being 
translated into a new avoidance constraint pushed downwards in the decomposition tree. We then 
need to add new equations in the specification for C to take into account these new constraints. 

The main algorithm of this section is AmbiguousSystem (Algo. below), which uses auxiliary 
procedures described later on. We prove in Section 5.4 that the result it produces has the following 
properties: 


Theorem 5.1. Let C be a permutation elass with a finite number of simple permutations. Denote 
by B the (finite) basis of C, by B* the subset of non-simple permutations in B, by Sc the (finite) 
set of simple permutations in C, and by A{E) the set of permutations of a set A that avoid every 
pattern in a set E. The result of AmbiguousSystem(H, 5c) is a finite system of combinatorial 
equations describing C. The equations of this system are all of the form Dq = \ U U7r[Pi,...,P„], 
where Di = C^{B* U Bfi with 5 G { ) +; ~]|^ cind Bi contains only permutations corresponding to 
normalized blocks of elements of B*. This system contains an equation whose left part is C and is 
complete, that is: every Di that appears in the system is the left part of one equation of the system. 


An essential remark is that the obtained combinatorial system may be ambiguous, since it may 
involve unions of sets that are not always disjoint. We will tackle the problem of computing a 
non-ambiguous system in Section 

It is also to note that the result of AmbiguousSystem provides a finite query-complete set 
containing C: 


Corollary 5.2. Let £ be the system of equations output by AmbiguousSystem(H, 5c)- Then the 
set {D : D is the left part of some equation of £} is a query-complete set containing C. 


Proof. This a direct consequence of the form of £ described in Theorem 5.1 


□ 


^Theorem 9 of |AA05I Theorem 9] ensures that, as soon as C contains Hnitely many simple permutations, then 
the basis of C is finite. 

®For any set A of permutations, when writing for 5 G { , +, —}, we mean that A^ is either A or A'^ or A~. 
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Algorithm 1: AmbiguousSystem(S, ^c) 


Data: A finite basis of forbidden patterns defining C = Av{B) and the finite set Sc of simple 
permutations in C. 

Result: A system of equations of the form Pq = 1 U |J vr[Pi,..., Dn] defining C. 

begin 

<5 •«— EqnForClass(C, R*) /* See Algo. 0 ^P- 

while there is a right-only C^{E) in some equation of S do 
|_ U EqnForClass(C'^, E) 


21 ) */ 


5.1. A first system of equations. Consider a permutation class C, whose basis is B and which 
is not substitution-closed. We compute a system describing C by adding constraints to the system 
obtained for C, as in |AA05) . We denote by B* the subset of non-simple permutations of B and by 
A{E) the set of permutations of A that avoid every pattern in E, for any set A of permutations 
and any set E of patterns. Note that we have (A(R))'’' = A'^{E): the corresponding set is the one 
of permutations of A that avoid E and that are ©-indecomposable. The same goes for A~. 


Proposition 5.3. LetC be a permutation class, that contains 12 and 21. We have thatC^ = C^{B*) 
for 5 G { Moreover, 

vr[C,...,C](R’^) 


(4) 

C{B*) 

= 1 0 ©[C+,C](R*) 

1 

0 

0 

^ WttScSc 

(5) 

C+(R*) 

= 1 0 ©[C-,C](R*) 

^ lilTTScSc ■ ■ 

■,Cl(B*} 

(6) 

C-{B*) 

= 1 0 ©[C+,C](R*) 

WTrScSc^P’-- 

.,C](R*), 


all these unions being disjoint. 


Proof. Let a € C, then a € C and a avoids R*, thus a G C{B*). Conversely, let a G C{B*) and 
let IT € B. If TT G R* then a avoids vr. Otherwise, vr is simple and tt ^ C. Because = Sc by 


2.16 


this implies that vr ^ C. Since cr G C, cr avoid s tt. Hence cr G C. Finally C{B*) = C, 
= C^. Then the result follows from Proposition 4.2 □ 


Remark 
thus C^{B 

Equations Q to Q do not provide a combinatorial specification because the terms 7r[C,..., C] (R*) 
are not simply expressed from the terms appearing on the left-hand side of these equations. To solve 
this problem, instead of decorating all terms on the right-hand side of Equations 0-© with con¬ 
straint (R*) (like in Equations (Q-([^), we propagate the constraint (R*) into the subtrees. More 
precisely, by Lemma 18 of |AA05) . sets 7r[C,... ,C](R*) can be expressed as union of smaller sets: 

(7) vr[d,... ,C](R*) = ULi vr[C(R,,i),C(R,, 2 ), • • .,C{E,^k)] 

where the Eij are sets of permutations which are patterns of some permutations of R*. For instance, 
with C = Av{2‘il), we have B* = {231}, and 0[C“,C](231) = 0[C“(12),C(231)]. Note that the 
set C“(12), which is not a part of the initial system, has appeared on the right-hand side of this 
equation, and we now need a new equation to describe it. In the general case, applying Equation (Q 


in the system of Proposition 5.3 introduces sets of the form C°{Eij) on the right-hand side of an 


equation of the system that do not appear on the left-hand side of any equation. The reason is 
that {C,C^,C~} is not query-complete in general. Propagating the constraints in the subtrees as 
described below allows to determine a query-complete set which contains C (see Corollary 5.2). 

We call right-only sets the sets of the form C^{Eij) which appear only on the right-hand side of 
an equation of the system. For each such set, we need to add a new equation to the system, starting 
from Equation (Q, ([^ or ([^ depending on 6, and propagating constraint Eij instead of R*. This 
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may create new right-only terms in these new eqnations, and they are treated recnrsively in the 
same way. This process terminates, since the Eij are sets of patterns of elements of B*, and there 
is only a hnite nnmber of snch sets (as B is hnite). 

The key to the precise description of the sets Eij, and to their effective compntation, is given by 
the embeddings of permntations 7 that are patterns of some /3 G B* into the simple permntations 
TT of C. 


5.2. Embeddings: definition and computation. Recall that e denotes the empty permntation, 
i.e. the permntation of size 0. We take the convention A{£) = 0. 

A generalized substitution (also called lenient inflation in |BHVn 8 ) ) (T{ 7 r^, 7 r^,... , 7 r"'} is dehned 
like a snbstitntion with the particnlarity that any tt* may be the empty permntation. Note that 
cr[ 7 r^, 7 r^,... ,7r^] necessarily contains a whereas iT{ 7 r^, 7 r^,... jTt”} may avoid a. For instance, the 
generalized snbstitntion 1 3 2{2 1, £, 1} gives the permntation 213 which avoids 13 2. 

Thanks to generalized snbstitntions, we dehne the notion of embedding, which expresses how a 
pattern 7 can be involved in a permntation whose decomposition tree has a root vr: 


Definition 5.4. Let vr = vri... 7 r„ and 7 be two permutations of size n and p respectively and 
the set of interval^ of 7 , including the trivial ones. An embedding of 7 in tt = vri... vr^ is a map a 
from { 1 ,..., n} to P.y such that: 

• if the intervals a{i) and a{j) are not empty, and i < j, then a{i) consists of smaller indices 
than a(j); 

• as a word, a(l)... a{n) is a factorization of the word 1 ... I 7 I (which may include empty 
factors). 

• it holds that ■ ■ ■ )7o(n)} = 7 Definition\2. (p^ for the definition of 


Example 5.5. For any permutations 7 and n, a : 
Indeed 7 [i.,| 7 |] = 7 and 7 r{ 7 , e,..., e} = 7 . 



^[l..|7|] 
1-^ 0 


is an embedding of 'y in n. 


Note that if we denote the non-empty images of a by ..., and if we remove from tt the tti 
snch that a{i) = e, we obtain a pattern a of vr snch that 7 = (t[ 7 q 1 , ... , 7 Q,iv]. Bnt this pattern a 
may occnr at several places in vr so a block decomposition 7 = cr[ 7 Q,i,... , 7 aJv] may correspond to 
several embeddings of 7 in vr. 


Example 5.6. There are 12 embeddings of j = 546312 into vr = 3142, shown in Ta 6 /e 
For instance, when writing 7 as the substitution ©[3241,12], they are derived from the generalized 
substitutions vr{3241,12, e, e}, vr{3241, e, e, 12} and vr{e, e, 3241,12}, corresponding to the three oc¬ 
currences of 21 in vr. But when writing 7 as 312[3241,1,1], since 312 has only one occurrence in vr, 
only one embedding is derived, which comes from vr{3241, l,e, 1}. 

Note that this dehnition of embeddings conveys the same notion as in |AA05) . bnt it is formally 
different and it will tnrn ont to be more adapted to the dehnition of the sets Eij in Section 

For now, we present how to compnte the embeddings of some permntation 7 into a permntation 
vr. This is done with AllEmbeddings (Algo. in two main steps, as snggested by the two parts 
of Table First we compnte all block decompositions of 7 (the left part of the table shows only 
some block decompositions of 7 = 546312, namely those that can be expressed as a generalized 
snbstitntion in vr = 3 14 2). Then for each block decomposition of 7 , we compnte all the embeddings 
of 7 into vr which correspond to this block decomposition (this is the right part of the table). 


5.3 


'^Recall that in this arti cle, an interval of a permutation is a set of indices corresponding to a block of the 
permutation (see Definition |2.5|p[^. 
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7«(i) 

7a ( 2 ) 

7a(3) 

7o(4) 

7 = 1[546312] = 7r{546312, e, e, e} 

= 7r{e, 546312, e,e} 
= 7r{e,e, 546312, e} 
= 7r{e,e,e, 546312} 

546312 

e 

e 

£ 

e 

546312 

£ 

£ 

e 

e 

546312 

£ 

e 

e 

£ 

546312 

7 = ©[213,312] = 7r{213,312,e,e} 

= 7r{213,e,e,312} 

= 7r{e,e,213,312} 

213 

312 

£ 

e 

213 

e 

£ 

312 

e 

e 

213 

312 

7 = ©[3241,12] = 7r{3241,12,e,e} 

= 7r{3241,e,e,12} 

= 7r{e,e,3241,12} 

3241 

12 

e 

e 

3241 

e 

e 

12 

e 

£ 

3241 

12 

7 = 231[21,1,312] = 7 r{ 21 ,e, 1,312} 

21 

£ 

1 

312 

7 = 312[3241,1,1] = 7r{3241,l,e, 1} 

3241 

1 

£ 

1 


Table 1. The embeddings of 7 = 546312 into vr = 314 2. 


Algorithm 2: AllEmbeddings( 7 , vr) 

Data: Two permntations 7 and vr 
Result: The set of embeddings of 7 into vr 

begin 

S 

P BlockDecompositions( 7 ) /* See Algo. [^ */ 

foreach d G D do 

|_ EMBEDDINGS(d, vr) /* See Algo. */ 

return E 


The procedure BlogkDegompositions (Algo. hnds all the block decompositions of 7 . It 
needs to compute all the intervals of 7 . Such intervals can be described as pairs of indices (i,j) 
with i < j such that maxj<fc<j( 7 fc) — minj<fc<j( 7 fc) = j — i- Denoting by p the size of 7 , this 
remark allows to compute easily all the intervals starting at i, for each i G [l-.p] - see INTER- 
VALs( 7 , i). Then, BlogkDegompositions builds the set V of all sequences of intervals of the 
form ((ii, ji), • • ■) (*m, jm)) with ii = 1, jm = p, and = Jfc + 1 for all k < m. These sequences 
correspond exactly to the block decompositions of 7 . They are computed iteratively, starting from 
all the intervals of the form ( 1 , i) and examining how they can be extended to a sequence of intervals 
in D. To this end, note that any sequence ((ii, Ji), ■ • •, {im,jm)) as above but such that jm 7 ^ p is 
the prehx of at least one sequence of D, since for every i G [l-.p], at least (i, i) is an interval of 7 . 

For each i G [l-.p], computing lNTERVALS( 7 ,i) is done in 0{p), so 0{p^) is enough to compute 
once and for all the results of INTERVALS( 7 ,i) for all i G [l-.p] (provided we store them). The 
computation of all block decompositions of 7 with BlockDegompositions( 7 ) then costs 0{p2P). 
Indeed there are at most 2^“^ such sequences of V and each sequence of V contains at most p 
intervals. At each step, the algorithm extends a sequence already built. Thus the (amortized) 
overall complexity is 0{p2'P) and this bound is tight. 

The procedure Embeddings (Algo. hnds the embeddings of 7 in tt which correspond to a 
given block-decomposition of 7 . The output T) of BlogkDegompositions corresponds to all 
the substitutions (t[ 7 ^^^ which are equal to 7 . For each d G P we hrst determine the 

corresponding skeleton a dehned as the normalization of a sequence s\ ... Sm oi m integers, where 
each Si is an element of 7 falling into the i-th block of this decomposition. Then, we compute the 
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Algorithm 3: BlockDecompositions( 7 ) 

Data: A permutation 7 

Result: The set T) of block decompositions of 7 

begin 

^ 0; V Intervals( 7 , 1) 
foreach u= ji), • • •, (*m, jm)) G 7^ do 
V ^V\{u] 

if 3m = I 7 I then "D U {«} else 

S ^ Intervals( 7 , + 1) 

V‘^vyj{u-s\s£S} 

return V 

/* Returns the set of intervals of 7 of the form (ijj) */ 

Intervals ( 7 ,^) 

0 

max •(— 7 i; min <— 7 * 
for j from i to I 7 I do 

max max(max, 7 ^); min ^ min(min, jj) 

[_ if max — min = j — i then X ^ ^U{(7j)} 

_ return X 









The preprocessing part of Embeddings (Algo. Q, which consists in the compntation of the 
skeleton a, costs 0{m). The examination of all possible occnrrences of a in tt is then performed in 
0{m (^)), where n is the size of tt. 

In total, compnting the set D of block decompositions of 7 is performed in 0{p2P). The set 
P contains at most block decompositions in m blocks, so that the complexity of the main 

loop of AllEmbeddings is at most X]m=i "^(m) (m-i) — Note that it can be rednced 

to min(p, n) by discarding all block decompositions of 7 in m > n blocks, since these 

will never be nsed in an embedding of 7 into vr. The npper bound X]m=i ™(m) (m-i) tight, as 
can be seen with p < n, 'y = 12 ... p and vr = 12 ... n. 

In the next section, we explain how to nse embeddings to propagate the pattern avoidance 
constraints in the snbtrees. 


5.3. Propagating constraints. To compnte onr combinatorial system, we compnte eg nations 
for sets C^{E) (initially for C{B*), that is C) starting from Eqnation ( 0 , 0 or (0 (p@. For 
every set 7 r[Ci,... ,C„] that appears on the right-hand side of the eqnation, we pnsh the pattern 
avoidance constraints of E in the snbtrees. This is achieved nsing embeddings of exclnded patterns 
in the root vr. For instance, assnme that 7 = 546312 G B* and Sc = {3142}, and consider 
3142[C,C,C,C](7). The embeddings of 7 in 3142 indicates ho w th e pattern 7 can be fonnd in the 
snbtrees in 3142[C, C, C, C]. The first embedding of Example 5.6 indicates that the fnll pattern 7 


can appear all inclnded in the hrst snbtree. On the other hand, the last embedding of the same 
example tells ns that 7 can spread over all the snbtrees of 3142 except the third one. In order to 
avoid this particniar embedding of 7 , it is enongh to avoid one of the indnced pattern 7 / in one of 
the snbtrees. However, in order to ensnre that 7 is avoided, the constraints resniting from all the 


embeddings mnst be considered and merged. This is formalized in Proposition 5.7 


Proposition 5.7. Let tt be a simple permutation of size n and Ci ,... ,Cn be sets of permutations. 
For any permutation 7 , the set tt[Ci, ... ,Cn]{'y) rewrites as a union of sets of the form vr[Pi,... ,Pn] 
where, for all i, T>i = Cj( 7 ,...) and the restrictions appearing after 'y (if there are any) are patterns 
of y corresponding to normalized blocks of y. 

More precisely, we have 


( 8 ) 


7 r[Ci,..., C^] ( 7 )— [0 ,..., 

{ki,...,ki)&KTy 


where Kf = {{ki, ...,ki) G [l..n]^ | Vi, ya^ki) / ^ and 7 ai(fc,) + 1} and E^M-kt = I * ^ 

[l..£] and ki = m}, {oi \,..., ai} being the set of embeddings of y in vr. 

Similarly, ®[Cf ,C 2 ]{y) (resp. Q[Cf ,C 2 ]{y)) rewrites as the union over K)(^ (resp. of sets 

©[T>+,T> 2 ] (resp. Q['Df,'D 2 ]) withVi = Ci{Ei^ki...ke)- 


Proposition 5.7 and its proof heavily borrow from the proof of Lemma 18 of |AA05) . There are 
however several differences. 

In the hrst part of onr statement, while we stop at the condition T>i = Ci{y, ...) (which appears 
in the proof of Lemma 18 in |AAn5) 1. |AAn5) rephrases it as: Pj is Ci{y) or a strong snbclass of 
this class (that is, a proper snbclass of Ci which has the property that every basis element of Pj is 
involved in some basis element of Ci). Note that this rephrasing is not always correct (bnt this does 
not affect the correctness of the resnlt of |AAn5| which nses their Lemma 18). A connter example is 
obtained taking vr = 2413, Ci = Av{12) for all i and 7 = 2143. Then, becanse of the embedding of 
7 in TT that maps 21 in tti and 43 in tt 2 , we get a term with T>i = Ci(2143, 21) = Av{12, 21), which 
is not a strong snbclass of Ci( 7 ) = Av{12). 
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The second part of Proposition 5.7 is not present in |AA05) . That is, Proposition |5.7| goes further 


than the proof of Lemma 18 of |AA05| : we provide a statement which is nonetheless constructive 
as the proof of |AA05| . but also explicit, so that it can be directly used for algorithmic purpose. 


Proof. We hrst consider the case of a simple root tt. Let 7 be a permutation and {ai,... ,a(} 
be the set of embeddings of 7 in vr, each ai being associated to the generalized substitution 7 = 
) • • • ) 7ai(n)}' 

Let a = where each G C^. Then a avoids 7 if and only if for every em¬ 

bedding ai (with 1 < i < i), there exists ki G [l..n] such that "fai{ki) is not a pattern of 
i.e. such that avoids 'Jaiiki)- Equivalently, a avoids 7 if and only if there exists a tuple 

(fci, ... ,k() G [l..n]^ such that for every embedding a^ (with 1 < i < £), avoids 70 - 7 ^ 7 - Thus, 

l 

7 r[Ci,...,C„]( 7 ) = IJ p| 7 r[Ci,...,Cfc,( 7 «,(fc 7 ),...,C„]. 

(fci,...,fc^)e[l..n]^ *=1 

But, for any set A of permutations we have A{e) = 0. So if for some i G [l.-f*], 7ai{ki) = then 

ni=i TTpi,. ■. ,Cfc;( 7 Q, 7 fc 7 ), ... ,Cn] = 0- The same goes for the trivial permutation 1 since every 
permutation contains 1 . 

Therefore, we have: 


l 

7r[Ci,...,C„](7) = IJ p|7r[Ci,...,Cfc,(7«,(fc7),...,C„], 
(ku...,kt)eK^ *=i 


5.6 


with Kf = {{ki,...,ke) G | Vi, 7ai(fci) A e and A !}■ Following Example 

and denoting ai to ai 2 the embeddings of Table from top to bottom, we have for exainple 


k = (1,2,3,4,1,4,4, 2,1,4,4,1) G a;. 

Moreover, as vr is simple, by uniqueness of the substitution decomposition we have for any sets 
of permutations Ei,, En, Ei,..., En'. 


Tr[Ci{Ei),.. .,Cn{En)] n 7r[Ci(Fi),... ,C„(F„)] = 7r[Ci(Ai U Ei), ... ,Cn{En U F„)]. 


Thus, 


7r[Ci, ... ,C„]( 7 ) — J 7r[Ci(Ai^fcj, ki...kt)]- 

{ki,...,kt)&K^ 

where Ejn,kx...ki = {lai(ki) I ^ G [l.-f*] and ki = m}. Following the same example again, Ei ]^ = 
{ 7 ai(i), 7 a 5 (i)> 7 a 9 (i)> 7 ai 2 (i)} = {546312,213,3241}, = {546312,12}, Ag^k = {546312} and 

Ayk = {546312,312,12}. 

Proposition 5.7 follows as soon as we ensure that each set Em,ki...ki contains 7 and possibly other 
restrictions that are patterns of 7 corresponding to normalized blocks of 7 . For a given m G [l-.n], 
there always exists an embedding of 7 in tt that maps the whole permutation 7 to vr^. Denoting 
this embedding we have 'yaj^(m) = 7 = e for g / m. Consequently, if kj^ A 

then laj^{kj^) = £ {ki,... ,ke) ^ -^7 ■ Therefore when {ki,..., ki) G Kf then kj^ = m and the 
set Em,ki...ki contains at least 'laj^ikj^) = 7- Moreover, by definition its other elements are patterns 
of 7 corresponding to normalized blocks of 7 . 

Notice now that the proof immediately extends to the case of roots © and 0 . Indeed, in the above 
proof, we need vr to be simple only because we use the uniqueness of the substitution decomposition. 
In the case vr = © (resp. ©), the uniqueness is ensured by taking the set Cf of ©-indecomposable 
permutations of Ci (resp. the set Cf of ©-indecomposable permutations). □ 
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Example 5 . 8 . For vr = © and 7 = 3412, there are three embeddings of j in tt; ai which follows 
from the generalized substitution 3412 = ©{3412, e}, 02 which follows from 3412 = ©{e,3412}, 
and as which follows from 3412 = ©{12,12}. So Kf = {(1, 2,1), (1, 2, 2)} and the application of 
Equation (|^ gives 

©[Cf,C2](3412) = ©[Ci-(3412,12),C 2 (3412)] U©[Cf(3412),C 2 (3412,12)], 
which simplifies to ©[C]",C2](3412) = ©[C]”(12),C2(3412)] U ©[C]”(3412),C2(12)]. 

By induction on the size of P, Proposition |5.7| extends to the case of a set P of excluded patterns, 
instead of a single permutation 7 : 

Proposition 5 . 9 . For any simple permutation tt of size n and for any set of permutations P, the 
set 7 r[Ci,... ,Cn]{P) rewrites as a union of sets , Pn] where for all i, Pi = Ci{P U Pi) with 

Pi containing only permutations corresponding to normalized blocks of elements of P. 

Similarly, ©[C{",C 2 ](P) (resp. Q[Cf ,C 2 ]{P)) rewrites as aunion of sets ®\Pi ,P 2 ] (resp. Q[Pf ,P 2 ]) 
where for i = 1 or 2, Pi = Ci{P U Pi) with Pi containing only permutations corresponding to nor¬ 
malized blocks of elements of P. 

Now we have all the results we need to describe an algorithm computing a (possibly ambiguous) 
combinatorial system describing C. 


5.4. An algorithm computing a combinatorial system describing C. We describe the algo¬ 
rithm AmbiguousSystem (Algo, [^p, 15) that takes as input the basis P of a class C and the set 
Sc of simple permutations in C (both finite), and that produces in output a (possibly ambiguous) 
system of combinatorial equations describing the permutations of C through their decomposition 
trees. Recall (from p,15) that P* denotes the subset of non-simple permutations of P. 

The main step is performed by EqnForClass (Algo.below), taking as input Sq, <5 G { , +, —} 
and a set E of patterns (initially P*), and producing an equation describing C^{E). The algorithm 
takes an equation of the form ([Tl),(§ or (|^ (pjl3|) describing and adds one by one the constraints 
of E using Equation (Isl) as described in procedure AddConstraints. 


Algorithm 5: EqnForClass(C'^, P) 

Data: P is a set of permutations, is given by Sc and (i G { , +, — } 

Result: An equation defining C^{E) as a union of '7r[Ci, ... ,Cn] 

begin 

I S ^ Equation Q or (|^ or (|^ p, 
foreach constraint 7 in P do 

foreach t = 7r[Ci,... ,Cn] that appears in S do 
^ t •(— ADDCONSTRAINTS(7r[Ci,... ,Cn],7) /* this Step modifies S */ 

return S 


13 


(depending on (i), replacing the left part by C^{E) 


/* Returns a rewriting of tt\Ci ... Cn\{"f) as a union (J 7 r[Pi,... P„] 
AddConstraints (vrfCi.. .Cn],7) 

compute all the embeddings of 7 in vr with AllEmbeddings /* See Algo.j^ (p. 17) 
compute Kf and sets Em,ki...ki defined in Equation ([^ 
return '^Pl(Pl,fci...A:^), • • ■ , Cn(Pn,A:i...fc^)] 


*/ 

*/ 
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The procedure AmbiguousSystem keeps adding new equations to the system which consists 
originally of the equation describing C{B*), that is C. This algorithm repeatedly calls EqnFor- 
Class until every C^{Ei) appearing in the system is dehned by an equation. All the sets E are sets 
of normalized blocks (therefore of patterns) of permutations in B*. Since B is hnite, there is only 
a hnite number of patterns of elements of B*, hence a hnite number of possible E, and Ambigu- 
OUSSystem terminates. As for its complexity, it depends on the number of equations in the output 


system for which we give bounds in Section 6.5 


The correctness of the algorithm is a consequence of Propositions |5.3[ |5.7|and|5.9t which therefore 


completes the proof of Theorem 5.1 


Example 5.10. Consider the class C = Av{B) for B = {1243,2413,531642,41352}; C contains 
only one simple permutation (namely 3142}, and B* = {1243}. Applying the procedure Ambigu- 
OUSSystem to this class C gives the following system of equations: 


(9) 

C(1243) 

= 1 U ©[C+(12),C(132)] U ©[(1+(1243),C(21)] U ©[C-(1243),(1(1243)] 

U 3142[C(1243),C(12),(1(21),(1(132)] U 3142[C(12),(1(12),C(132),C(132)] 

(10) 

^■^(12) 

= 1 U ©[C-(12),C(12)] 

(11) 

C(132) 

= 1 U ©[C+(132),C(21)] U ©[C-(132),C(132)] 

(12) 

C(21) 

(1+(1243) 

= 1 U ©[C+(21),C(21)]. 


This is a simplified version of the actual output of AmbiguousSystem. For instance, with a 
literal application of the algorithm, instead of Equation ([^ we would get: 

C(1243) = 1 U ©[C+{1243,12),C(1243,132)] U ©[C+(1243),C(1243,132, 21)] U ©]C" (1243), C(1243)] 

U 3142]C(1243,12),C(1243,12),C(1243,132),C(1243,132)] U 3142]C(1243,12),C(1243,12),C(1243,132),C(1243,132,21)] 

U 3142]C{1243,12),C{1243,12),C{1243,132, 21),C(1243,132)] U 3142]C(1243,12),C{1243,12),C(1243,132, 21),C(1243,132,21)] 
U 3142]C(1243),C(1243,12),C{1243,132, 21),C{1243,132)] U 3142]C{1243),C{1243,12),C{1243,132, 21),C(1243,132,21)] 


Nevertheless, this union can be simplihed. The simplihcation process will be described more 
thoroughly in Section 6.6 We illustrate it by two examples. First, since a permutation that 


avoids 12 or 132 will necessarily avoid 1243, the term ©[({■’■(1243,12),(1(1243,132)] rewrites as 
©[({■'■(12),(1(132)] (see Proposition 


6.16 


p. 30E We can also remove some terms of the union, such 


as 


3142[(1(1243,12),C(1243,12), (1(1243,132),C(1243,132,21)] 
which is included in 3142[C(12), C(12), (1(132), C(132)] (see Proposition 


6.18 


30). Such simplifica¬ 


tions can be performed on the fly, each time a new equation is computed. 

We observe on Example 5.10 that the system produced by AmbiguousSystem (Algo. Q is 
ambiguous in general. In this case. Equation (|^ gives an ambiguous description of the class C(1243): 
the two terms with root © have non-empty intersection, and similarly for root 3142. Followin g the 
route of |AA05) . we could use inclusion-exclusion on this system. On Equation Q of Example ] 5.10 
this would give: 


C(1243)= 1 U ©^■^(12),C(132)] U ©^■^(1243),C(21)] \ ©[^■^(12),C(21)] 

U ©[({-(1243),(1(1243)] U3142[(l(12),(1(12),(1(132),(1(132)] 

U 3142[C(1243),C(12),(1(21),(1(132)] \ 3142[(1(12),C(12),C(21),(1(132)]. 


As explained earlier, this is not the route we follow. In the next section, we explain how to modify 
the algorithm AmbiguousSystem to obtain a combinatorial specihcation by introducing pattern 
containment constraints. 
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6. A NON-AMBIGUOUS COMBINATORIAL SYSTEM, i.e., A COMBINATORIAL SPECIFICATION 

The goal of this section is to describe an algorithm computing a specification for any permuta¬ 
tion class having finitely many simple permutations - see algorithm SPECIFICATION (Algo.|^. This 
algorithm proceeds as AmbiguousSystem (Algo. [I]pjl5[), but also transforms each equation pro¬ 
duced into a non-ambiguous one. The disambiguation of equations is performed by DISAMBIGUATE 
(Algo. §. This algorithm replaces ambiguous unions appearing in an equation by disjoint unions 
using complement sets, in the spirit of Figure 



AUBUC = ltt)2tt)3tt)4tt)5tt)6tt)7 

= {A nB nC) (A n B nC) \±i (A nB n C) 
tt) {A n B nC) {A riB n C) (A n B n C) 
tt) {AnBnC) 


Figure 5. Rewriting unions as disjoint unions. 

This may result in new terms appearing on the right side of the modified equation. Indeed, 
the terms of the system obtained from AmbiguousSystem involve pattern avoidance constraints 
(which were denoted {E)). Consequently, taking complements, we are left with new pattern con¬ 
tainment constraints as well (which we will denote (A)). These new terms need to be defined by 
an equation, to be added to the system. This is solved by the procedure EqnForRestriction 
(Algo.0, whose working principle is similar to that of EqnForClass. 

Finally, EqnForRestriction and Disambiguate combine into Specification (Algo. [^, 
which is our main algorithm. 


Algorithm 6: Specification(R, 5c) 

Data: A finite basis of patterns defining C = Av{B) and the finite set Sc of simple 
permutations in C. 

Result: A combinatorial specification defining C. 

begin 

S ^ EQNFORRESTRICTION(C,i?*,0) /* See Algo.j^ while there is an equation F in E 
that has not been processed do 

F ■(r- Disambiguate(E) /* See Algo.|^*/ 

while there exists a right-only restriction C^{E){A) in equation F do 
L 5 ^ 5|J EqnFdrRestrictiqn(C‘^,E,A). 

return £ 

*/ 


6.1. Presentation of the method. We start by introducing notation to deal with the pattern 
containment constraints. 

Definition 6.1. For any set V of permutations, we define V{E)(A) as the set of permutations of 
V that avoid every pattern of E and contain every pattern of A: 

T’{E){A) = {a G V \ y-iT G E,7r a and Vvr G A, vr ^ a}. 
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When V = for (5 G { , } and C a permutation class, such a set is called a restriction. 

We also denote 'P{E) = 'P{%){E). 

Restrictions are a generalization of permntations classes. For A = tj), C{E){9) is the standard 
permntation class C{E). Any permntation class can be written as S{E) with S the set of all 
permntations and E a set of patterns that may be infinite. Likewise, any restriction can be written 
as S{E){A) with E a set of patterns that may be infinite, bnt we can always choose a finite set for 
A: if A is infinite, then S{E){A) = 0. 


Remark 6.2. Our convention that no permutation class contains the empty permutation e implies 
that e ^ C^{E){A), for any restriction C^{E){A). We can also make the assumption that e ^ E and 
e A, since C^{{e} U E){A) = 0 and C'^(Fl)({e} U A) = C^{E){A) for any E and A. Moreover we 
assume that AdE is empty and that 1 ^ E, otherwise C^{E){A) = 0. We finally assume that 1 ^ A 
since C^{E){A) = C^{E) {A \ {!}). 

Restrictions are stable by intersection as V{E){A) n 'P{E'){A') = V{E U E'){A U A'). 


Definition 6.3. A restriction term is a set of permutations 7r[2?i,P2) ■ ■ ■ for vr a simple per¬ 
mutation, or (B^Df , 1 ) 2 ] or Q[Df , 1 ) 2 ], where each Vi is a restriction of the form C{E){A). 


By nniqneness of the snbstitntion decomposition of a permntation (Theorem 2.11 pj^, restriction 
terms are stable by intersection and the intersection is performed component-wise for terms sharing 
the same root: 7r[Pi,...,P„] n 7r[7i, ■ ■ ■ ,Tn] = 7r[T*i n 71,..., Pn n Tn]- 


Now we have all the notions we need to present the general strnctnre of onr main algorithm: 
Specification (Algo.j^above). Adapting to restrictions the ideas developed for classes in Section]^ 
we obtain a non-ambignons eqnation for any restriction C^{E){A) for d G { , } within fonr steps 

(where l(yi) = 1 if A = 0 and 0 otherwise): 

• Step 1 , eqnation from the snbstitntion decomposition of permntations: 

C^{E){A) = \a) W ... Wli)^g5^7r[C,...,C](7;)(A) 

• Step 2, propagation of the avoidance constraints: 

C\E){A) = ^a) W ••• ^\ij^^Sc^i^LMC{Ei),...,C{Ei)]{A) 

• Step 3, propagation of the containment constraints: 

C^{E){A) = 1(a) W ... ^\i]^^Sc^i^iMC{E\){A\),...,C{Ei){W^)] 

• Step 4, disambignation of the eqnation: 

C\E){A) = l(^) W ... W Wfc6x.vr[C(i?(^)(Af ),... ,C{E':f){A'^)] 


The algorithm SPECIFICATION starts by compnting a non-ambignons eqnation for C = C(R*)(0), 
calling the procednres EqnForRestriction (performing Steps 1 to 3 above - see details in Algo.j^ 
p 25) and DISAMBIGUATE (performing Step 4 - see details in Algo. pj26l). The specification for 
C is completed by nsing the same method of fonr steps to obtain an eqnation for each C(Ej^)(A'j^) 
appearing on the right side of the prodnced eqnation, and again recnrsively to obtain an eqnation 
for each restriction that appears in the system. 

Even if we nse it only to compnte specifications for permntation classes (writing C = C(R*)(0)), 
this algorithm allows more generally to obtain a specification for any restriction S^{E){A) snch that 
S{E) has a finite nnmber of simple permntations (implying that E can be chosen finite). Indeed 
we only have to replace EqnForRestriction(C,R, 0) with EqnForRestriction(C‘^,E,A), where 


C = S{E). 

We prove in the next three snbsections that the resnlt of onr main algorithm SPECIFICATION has 
the following properties: 


24 




Theorem 6.4. Let C be a permutation class given by its finite basis B and whose set Sc of simple 
permutations is finite and given. Denote by B* the set of non-simple permutations of B. 

The result of SPECIFICATION(i?, 5c) is a finite combinatorial system of equations of the 

form Dq = -Z[igDQ] wy 7 r[Pi,... where -^[igDo] is the class consisting in a unique permutation of 

size 1 if the permutation 1 belongs to Dq and is empty otherwise, and where each Dj is a restriction 
C^{E){A) with 5 G { and E and A containing only normalized block^ of elements of B*. 

Moreover C appears as the left part of an equation, and every Pj that appears in the system is the 
left part of one equation of the system. 

In particular this provides a combinatorial specification of C. 

Corollary 6.5. Let £ be the system of equations output by SPECIFICATION(i?, 5c). Then the set 
I'D : D is the left part of some equation of £} is a query-complete set containing C. 

Proof. This a direct consequence of the form of £ described in Theorem |6.4[ □ 

6.2. Computing an equation for each restriction. Let C^{E){A) be a restriction. Our goal 
here is to find an equation describing this restriction using smaller restriction terms (smaller w.r.t. 
inclusion). 

If A = 0, this is exactly the problem addressed in Section and solved by pushing down the 
pattern avoidance constraints with the procedure AddConstraints of EqnForClass (Algo. [^. 
The procedure EqnForRestriction (Algo. below shows how to propagate also the pattern 
containment constraints induced by A 7 ^ 0 . 


Algorithm 7: EqnForRestriction(C^, E, A) 


Data: C^, E, A with E, A sets of permutations, given by 5c and 5 G { , +, — 

Result: An equation defining C^{E){A) as a union of restriction terms. 

begin 

£ ^ Equation Q or (|^ or (|^ (depending on 6), replacing the left part by C^{E){A) 
foreach avoidance constraint 7 in E do 

foreach t = 7r[Ci, ... ,Cn] that appears in £ do 
^ t ^ ADDCONSTRAINTS(7r[Ci,... ,Cn], 7 ) /* See Algo.|^ (p.21) */ 


foreach containment constraint 7 in A do 

foreach t = 7 r[Ci,... ,C„] that appears in £ do 
^ t <— ADDMANDATORY(7r[Ci, . . . ,C„],7) 

return £ 


AddMandatory (7r[Ei,... ,I)„],7) 
I return a rewriting of 'k\Vi, ... 


] ( 7 ) as a union of restriction terms using Eq. (13) below 


The pattern containment constraints are propagated by AddMandatory, in a very similar 
fashion to the pattern avoidance constraints propagated by AddConstraints. To compute t{'y) 
for 7 a permutation and t = 'k\Pi, ... a restriction term, we first compute all embeddings of 7 
into vr. In this case, a permutation belongs to t( 7 ) if and only if at least one embedding is satisfied. 
Then 'k\V\, .. ■ ,E„]( 7 ) rewrites as a union of sets of the form 7 r[Ei( 7 i),... ,E„( 7 „)] where, for all 
i, 7 j is a normalized block of 7 which may be empty or 7 itself (recall that if 7 ^ is empty, then 
Dji'yi) =Vj). More precisely: 


® Recall from Definition 
7 to any of its intervals I. 


2.6 


that the normalized blocks of 7 are the permutations 7 / obtained when restricting 
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Proposition 6.6. Let tt be a permutation of size n and Di, ... be sets of permutations. For 
any permutation j, let {oi,..., be the set of embeddings of ^ in tt, then 

i 

(13) 7r[Pi, . . . ,Pn](7) = U 7rpl(7ai(l)),^2(7ai(2)), ■ ■ • ,^n(7ai(n))]- 

i=l 


For instance, for t = 3142[Pi,2^2;^3)^4] and 7 = 546312, there are 12 embeddings of 7 into 
3142 (see Table[^p, 17), and the embedding 3142{21,e, 1,312} contributes to the above union with 
the term 3142[Pi(21),P2,7^3(1),714(312)]. 


Proof. Let a G 7r[Pi,... ,Pn]; then a = '7r[<Ti,... ,an] where each Uk G Pfc- Then a contains 7, if 
and only if there exists an embedding Oi of 7 = vr[7„7i)... 7a7n)] such that is a pattern of aj 

for all j. □ 


Hence, any restriction term t = 7r[Pi,..., P„](7) rewrites as a (possibly ambiguous) union of 
restriction terms. 


6.3. Disambiguation procedure. As explained earlier. Disambiguate (Algo. disambiguates 
equations introducing complement sets. 


Algorithm 8: Disambiguate(F) 


Data: A potentially ambiguous equation F dehning a restriction Result: A non-ambiguous 
equation equivalent to F 

begin 

foreach root tt that appears several times in F do 

Replace the union of the restriction terms of F whose root is vr by a disjoint union using 


Equations (14), (15) and (16) below. 

return F 


Every equation produced by EqnForRestrigtion is written as t = 1 U H U t2 U ts ... U tfc where 
the sets ti are restriction terms (some 7r[Pi, P2) • • • 5 T^n]) and t is a restriction (some C^{E){A)). By 
uniqueness of the substitution decomposition of a permutation, restriction terms of this union which 
have different roots vr are disjoint. Thus for an equation we only need to disambiguate unions of 
terms with same root. For example in Equation ([^ (p 22), there are two pairs of ambiguous terms 
which are terms with root 3142 and terms with root ©. Every ambiguous union can be written in 
an unambiguous way: 


Propositiou 6.7. Let Ai ,..., An be n sets and for each of them denote A, the complement of Ai 
in any set containing (JILi T/ie union IJILi rewrites as the disjoint union of the 2” — 1 sets 
of the form fjiLi with Xi G {Ai, A^} and at least one Xi is equal to Aj. 


This proposition is the starting point of the disambiguation. 8ee 1 igure|5| (pj23p for 
In order to use Proposition 6.7 we have to choose in which set we take complements. 


Defiuitiou 6.8. For any restriction term t, we define its complement t as follows: 

• if t = vr[Pi,..., Fn] with vr simple and for all i, Pj C C, we set t = 7r[C,..., C] \ t; 

• if t = ® \p^, P2] with Pi, P2 C C, we set t = © [C+, C] \ t; 

• if t = ©[P]", P2] with Pi, P2 C C, we set t = Q[C~,C] \ t. 

Moreover for any restriction P of with (5 G { , +, —}, we set P = \ P. 
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From Proposition |6.7[ every ambiguous union of restriction terms sharing the same root in an 
equation of our system can be written in the following unambiguous way: 

(14) Ui=l = Wjs:C[l...A:],X/0 riiex fljeX 

For instance, consider terms with root 3142 in Equation ([^: = 3142[C(12), C(12), (5(132), C(132)] 

and t 2 = 3142[(5(1243),(5(12),(5(21),(5(132)]. Equation (14) applied to ti Ut 2 in Equation ^ gives 
an expression of the form 

C(i243) = 1 u ©[...] u ©[...] u ©[...] u (ti n t 2 ) tt) (ti n t^) © (tln t 2 ). 

We now explain how to compute the complement t of a restriction term t. 


Proposition 6.9. Let t = '7r[Pi, ... ,'Dn] be a restrietion term. Then t is the disjoint union of the 
2^ — 1 sets of the form 7r[dfi, ..., Atn] with Xi G {Ti, Ti}, and not all ft) are equal to T^: 

(15) t = y '^\T{,... where T[=Ti if i € X and T[ = Ti otherwise, 


For example, ©[Pi,©>2] = Q[Ti,T 2 ] ©©[^ 1 ,^ 2 ] W©Pi,7 ?2 ]- 

Proof. Recall that t = 7r[C,... ,C]\t. Let a = TT\ai,..., an] G t. Assume that for each i ai € Ti, hy 
uniqueness of substitution decomposition we get a contradiction. Therefore a G vr[ft’i,... ,Xn] with 
ft) G {Ti,Ti}, and not all A) are equal to P*. 

Conversely if ct G 7 r[A’i,..., A)i] with A) G {Pj,Pi} and at least one A) is equal to Pj, then 
a G 7 r[(5 ,... ,C] and a ^ t. 

Finally for such sets ft) that are distinct, the sets 7 r[ft’i,... ,Xn] are disjoints. Indeed Pj H Pj is 
empty and the writing as 7 r[cri,..., an] is unique. So the union describing t is disjoint. The proof is 
similar when 7r = ©or7r = ©. □ 


Proposition 6.9 shows that ti is not a restriction term in general. However it can be expressed 
as a disjoint union of some vr[P(,... ,P)i], where the P( are either restrictions or complements of 
restrictions. The complement operation being pushed from restriction terms down to restrictions, 
we now compute P, for a given restriction P = C^{E){A), T denoting the set of permutations 
of that are not in P. Note that, given a permutation a of A, then any permutation r of 
C^{a) is in P because r avoids a whereas permutations of P must contain a. Symmetrically, if 
a permutation a is in E then permutations of C^(a) are in P. It is straightforward to check that 


C^(E}(A)=[U 


(jGE ' 


we can rewrite it as an unambiguous union: 


(cr)]. Unfortunately this expression is ambiguous. As before. 


Proposition 6.10. Let T = C^{E){A) he a restriction with h G { k = jPj and = |A|. 

Then T is the disjoint union of the — 1 restrictions {E'){A') with (E', A') a partition o/P©A 
such that [E',A') 7^ [E,A). In other words, 

(16) C‘(E)(A) = y C^{X U y)(y U X), where X = A\ X and Y = E \Y. 

XCA,YCE 

XxY^tlxl} 


Proof. Let t £T = C^\T. Dehne P' = {vr G EVJA | vr 7^ r} and A' = {vr G EVJA ] vr ^ r}. Observe 
that T G {E'){A'). Moreover E' A' = tj), E' A A' = E A A and {E',A') ^ {E,A) otherwise r 
would be in P. 

Conversely let r G {E'){A') with [E', X) a partition of EA A such that [E', X) 7^ [E, A), then 
T G . As {E',X) 7^ [E,A), either there is some a in P that r contains, or there is some a in A 
that r avoids. In both cases, t ^T thus r € \ T = T. 
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Finally for distinct partitions {E',A') of E VJ A, the sets C^{E'){A') are disjoints. Indeed a 
permutation in two sets of this form would have to both avoid and contain some permutation of 
E[J A, which is impossible. □ 


Proposition 6.10 shows that V is not a restriction in general but can be expressed as a disjoint 
union of restrictions. For instance, 

C(231,123)(4321) =C(123, 231, 4321) tt) C(123)(231,4321) tt) C(231)(123,4321) tt) 

C(4321)(123,231) W C(123,4321)(231) l±) C(231,4321)(123) l±) C(123,231,4321). 

Moreover by uniqueness of the substitution decomposition, 

7r[Pi,... tt) ..., Vn] = vr[Pi,... ,'Dk, ■ ■ ■, En] tt) 7r[2?i,... ..., P„]. 


Therefore using Equations (15) and (16) we have that for any restriction term tj, its complement ti 


can be expressed as a disjoint union of restriction terms: 

Proposition 6.11. For any restriction term t, its complement t can be written as a disjoint union 
of restriction terms. More precisely ift = 7r[Pi,... ,'Dn] with Di = C^^{Ei){Ai) and m = l-E'i| + 

then t is the disjoint union of the 2"^ — 1 restriction terms t = 7r[)Dj,..., such that for all i, 
{E[){A'j) with {E[, A'f) a partition of Ei^Ai, and there exists i such that {E[, A'f) ^ {Ei, Ai). 


By distributivity of intersection over disjoint union. Equation (14) above can therefore be rewrit 


ten as a disjoint union of intersection of restriction terms. Because restriction terms are stable by 


intersection, the right-hand side of Equation (14) is hereby written as a disjoint union of restriction 
terms. This leads to the following result: 

Proposition 6.12. Any union of restriction terms can be written as a disjoint union of restriction 


terms, and this can be done algorithmically using Equations (14), (15) and (16). 


Altogether, for any equation of our system, we are able to rewrite it unambiguously with disjoint 
unions of restriction terms, using the algorithm DISAMBIGUATE. 


6.4. Specification: an algorithm computing a combinatorial specification describing 

C. The procedures described above finally combine into SPECIFICATION (Algo. [6| pj23[), the main 
algorithm of this article, which computes a combinatorial specification for C. Equations of the 
specification are computed iteratively, starting from the one for C: this is achieved using EqnEor- 
Restriction (Algo.j^ described in Section 6.2 which produces equations that may be ambiguous. 
As we do not know how to decide whether an equation is ambiguous or not, we apply DISAM¬ 
BIGUATE (Algo. to every equation produced. Since some new right-only restrictions may appear 
during this process, to obtain a complete system we compute iteratively equations defining these 
new restrictions using again EqnForRestriction. 

The termination of SPECIFICATION is easy to prove. Indeed, for all the restrictions C^{E){A) that 
are considered in the inner while loop of SPECIFICATION, every permutation in the sets E and A is 
a pattern of some element of the basis B of C. And since B is finite, there is a finite number of such 
restrictions. Consequently, the algorithm produces an unambiguous system {i.e. a combinatorial 
specification) which is the result of a finite number of iterations of computing equations followed by 
their disambiguation. 

As for AmbiguousSystem (Algo. Q, the complexity of Specification depends on the number 
of equations produced, that we discuss in Section [6.5[ 
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6.5. Size of the specification obtained. The complexity of Specification (Algo.|^ depends on 
the nnmber of eqnations in the compnted specification, which may be qnite largej^ We were not able 
to determine exactly how big it can be, and conld only provide in Proposition|6.13|and Corollary|6.14 


npper bonnds on its size (he., nnmber of eqnations) which seems to be (very) overestimated. We 
leave open the qnestion of improving the npper bonnd on the size of the specification prodnced by 
onr method. However, we point ont that snch an npper bonnd cannot be less than an exponential 
(in the snm of the sizes of the exclnded patterns). Indeed, we give in Proposition 6.15 a generic 


example where onr method prodnces snch an exponential nnmber of eqnations in the specification. 
Nevertheless, this convolnted example was created on pnrpose, and in many cases the nnmber of 
eqnations obtained is not so high. 

Proposition 6.13. Let C = Av{B) and B* be the set of non-simple permutations of B. Let P* be 
the set of normalized blocks of permutations of B*. The number of equations in the specification of 
C computed by the procedure SPECIFICATION is at most 

Proof. In the specification we obtain, every equation is of the form 

C^{E){A) = ..., where 6 e { E U A C P\ 

As explained in Remark |6 .2 1 (p j24l) , we can fnrther assnme that EU A C P* \ {1} and that E (lA = 
0. The nnmber of eqnations is then bonnded by the nnmber of snch triplets (5, E, A) which is 
3i+{|p*|-i)^ □ 


Using the previons proposition and the fact that the nnmber of blocks of a permntation of size k 
is less than kf, we have the following conseqnence: 

Corollary 6.14. Let C = Av{B) and t = YI-kgB KI- number of equations in the specification 
of C computed by SPECIFICATION is at most 3^^. 


However, SPECIFICATION is designed to compnte only the eqnations we need, and the nnmber of 
eqnations prodnced is in practice mnch smaller. See for instance the example of Section where 
B* = {1243, 2341} and P* = {1,12, 21,123,132,1243, 2341}: the npper bonnd of Proposition |6.13 
is 3^ = 2187, bnt only 16 eqnations are effectively compnted. Bnt as shown by the following 
proposition, SPECIFICATION prodnces in the worst case a specification with a nnmber of eqnations 
that is exponential in t. 

Proposition 6.15. For each n > 4, there exists a class Cn = Av{Bn) whose specification computed 
by the procedure SPECIFICATION has at least 2^ equations, where the sum t of the sizes of 

the elements of B^ is approximately s, in the sense that 1 < t/s <C s. 


Proof. For any n > 4, denote by Sn the set of simple permntations of size n and by its cardinality. 
Remember from |AAKn3j that Sn ~ Fix some n > 4, let s = S 2 n-i, and define 7 = ©[n,..., Ts] 
with {© : 1 < i < s} = S 2 n-i and P„ = S 2 n U {7}. Note that Bn is an antichain, and consider the 
class Cn = Av{Bn). The snm of the sizes of the elements of Bn is t = 2n • S 2 n + (2n — 1) • S 2 n-i- 
Thns s <t and t/s ~ 4n^. Using Stirling formnla, t and s are both of order (^)^"'“'“ 

It is not hard to see that Cn contains a finite nnmber of simple permntations. Indeed, it follows 
from |ST93) (see details in |PR12| for instance) that Cn contains no simple permntations of size 2n 
or more. Note also that the simple permnt atio n tt = 246135 is small enongh that it belongs to Cn- 
Moreover, B* = {7} and from Proposition 5.3 Cn = Cni'j)- 

We claim that the compntations performed by ADDCONSTRAlNTS(7r[C„,... ,C„],7) in EqnFor- 
Restriction(P„) (Algo. [7|p|^ will create at least 2^ right-only terms, thns giving rise to at least 


6.13 


® The same g oes fo r the complexity of AmbiguousSystem. The bounds given in Proposition 
and Proposition 6.15 also hold for the number of equations of the system output by AmbiguousSystem. 
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2^ additional equations in the specification of C„. More precisely, with notation from Proposition|5.7| 


(p, 19), we prove that that for each subset E of S 2 n-i: there exists a tuple {ki,... ,ki) G such 


that E 2 ^ki,...ki = EL) { 7 }, ensuring that Cn{E U { 7 }) appear in the system of equations. 

Let us start by classifying the embeddings of 7 in vr into three categories. For all i G [l-.s], let us 
denote by a, the embedding of 7 in vr that sends r* to tt 2 , ©[ti, ..., Tj_i] to vri and ©[rj+i, ..., r^] 
to TTa; and let ag+i be the embedding of 7 in vr that sends 7 to 7r2. The remaining embeddings of 7 
in vr are denoted {a, | i G [s + 2 ..i]}. 

Note that for any i 7 ^ s + 1, there exists some ki G [1..6], with ki 7 ^ 2, such that 'Jaiiki) 7 ^ ^ 
7 oi(fci) ¥" 1 (since for each j, tj is simple and | 7 r| < \Tj\, thus Tj has to be entirely embedded in 
some TTfc). This remark allows to consider, for each subset E of S 2 n-i: a tuple {ki,.. .ki) defined as 
follows. For i G [l-.s], we set = 2 if r* G E, and otherwise we choose ki ^ 2 such that Jatiki) 7^ ^ 
and Jaiiki) 7 ^ 1- We set kg+i = 2. For i G [s + 2..£], we choose ki ^ 2 such that 70 , 7^7 7 ^ £ and 
7ai(fci) 7 ^ 1- Consequently, the following properties hold: 

- (ki,... kg) G K]) (defined in Equation ([^ 

- fcj = 2 if and only if r* G FI or z = s + 1; 

- for Ti G E, 7o7fc7 = r*; 

- and for z = s + 1 , Ja.iki) = 7 - 

This ensures that E 2 ^ki,...ki = E\J { 7 } as claimed. □ 

6 . 6 . Simplifications on the fly. During the computation of the equations by Specification 
(A lgo. §, many restriction terms appear, that may be redundant or a bit more intricate than 
necessary. For instance, in the equations obtained when pushing down the constraints in the subtrees 
using the rewriting described in Propositions |5.7| (pjl9|) and 6.6 (p 26), some element of a given union 
may not be useful because it may be included in some other element of the union. We simplify these 


P 


19); 


unions by deleting useless elements, using Proposition 6.18 below. Moreover, when a restriction T) 


of the form C^{E){A) arise, it can often be written as T? = {E'){A') with E' (resp. A') having 

fewer elements than E (resp. A). We use the description having as few elements as possible, thanks 
to Proposition 6.16 Proposition |6. 17 further allows some trivial simplifications. 

For any sets E and A of patterns, min FI (resp. max A) denote the subset of E (resp. A) containing 
all minimal (resp. maximal) elements of E (resp. A) for the pattern order 

Proposition 6.16. In any equation, every restrietion C^{E){A) may he replaced by 
(min FI) (max A) without modifying the set of permutations described. 

Proof The proposition is an immediate consequence of C^{E){A) = (minFI)(max A). This iden¬ 
tity follows easily from two simple facts: if a permutation a avoids tt then a avoids all patterns 
containing vr; and if a contains tt then a contains all patterns contained in tt. □ 

Proposition 6.17. The restriction term 7 r[Ci,... ,€„] is the empty set if and only if there exists i 
such that Ci = 0. In this case, Tr[Ci,... ,Cn] rnay be removed from any union of restriction terms 
without modifying the set of permutations described by this union. 

Proposition 6.18. Consider a union of restriction terms containing two terms with the same root 
7 r[Ci,... ,Cn] and 7r[T>i, ... ,Pn]- If for all i, Ci C T>i, then we may remove 7 r[Ci,... ,Cn] from this 
union without modifying the set of permutations it describes. 

Proof. If for all i, Ci C, T>i, then 7 r[Ci,... ,Cn] © giving the result immediately. □ 

Performing the simplifications of Proposition [ 6 A 6 | requires that we can compute min FI and max A 
effectively. This can be done naively by simply checking all pattern relations between all pairs of 


elements of E (resp. A). Similarly, to perform all simplifications induced by Propositions 6.17 and 
6.18 we would need to be able to decide whether Ci is empty or Ci ET>i, for any restrictions C, and 
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Vi. Lemmas 6.19 and 6.20 below give sufficient conditions for the emptiness and the inclusion of a 
restriction into another, hence allowing to perform some simplihcations. 


Lemma 6.19. A restriction C^{E){A) is the empty set as soon as there exist tt € E and a ^ A 
such that TT ^ a. 


Lemma 6.20. Let 5 G { } and Ei, E 2 , Ai and A 2 he any sets of permutations. Then 

C^{Ei){Ai) C C^{E 2 ){A 2 ) as soon as: 

• for each n G E 2 , there exists t € Ei such that r ^ vr, and 

• for each tt G ^ 2 , there exists r G such that tt ^ r. 

Proof. Assume the two conditions of the statement are satished. Consider a G C^{Ei)(Ai), and let 
us prove that a G C'^(i?2)(^2)- 

Let TT G E 2 . By assumption, there exists t € Ei such that r ^ tt. Since a G C^{Ei), a avoids r. 
From r ^ TT, we conclude that a also avoids tt. Therefore a G C^{E 2 ). 

Similarly, let vr G A 2 . There exists r G Ai such that vr ^ r. Since a G {Ei){Ai), we know that 
a contains r. Consequently, a also contains tt. Hence a G C^{E 2 ){A 2 ). □ 


Note that the condition given by Lemma |6.20| is sufficient, but it is not necessary. Indeed for 
El = {34152}, Ai = {364152}, we have C^{Ei){Ai) = 0. In particular C^{Ei){Ai) C C‘^(123)(132) 
even though the hrst condition of Lemma |6.20| is not satished. We may however wonder if the 
condition of Lemma 6.20| could be necessary under the assumption that Ei, E 2 , Ai and A 2 satisfy 
additional conditions, like {Ei){Ai) being non-empty and E 2 and A 2 being antichains. 

Similarly, the condition given by Lemma 6.19| is also sufficient, but it is not necessary. Indeed 
132, 213, 231, 312) (12, 21) is empty even though the condition of Lemma 


6.19 


is not satished. 


Any of the simplihcations explained above can be performed on the hy, each time a new restric¬ 
tion term appears while running the procedure SPECIFICATION. This allows to compute systems 
of equations signihcantly more compact than the raw output of our algorithm. We do not claim 
that these simplihcations constitute an exhaustive list of all possible simplihcations. But Propo¬ 
sitions [6]^ to [6]^ and Lemmas 6.19 and 6.20| cover all simplihcations that are performed in our 
implementation of SPECIFICATION, and in the examples of Section 


7. Examples 


We apply the method described in this article to hnd a combinatorial specihcation for three 
permutation classes. The hrst two are very small and easy examples, and are the examples of non- 
substitution-closed permutation classes dealt with in |BHV08) (Examples 4.3 and 4.4 of |BHV08| L 
They use only a fraction of the machinery we have developed, but have been chosen to illustrate 
some of the differences between our method and the one of |BHV08| . The third example is more 
involved, is meant to illustrate all of the auxiliary procedures dehned, and shows better what our 
methodology brings. 

7.1. Two examples from |BHV08) . 

7.1.1. The class C = Av{132). First, we note that C is not substitution-closed (indeed, the excluded 
pattern 132 is not simple). Next, we remark that C is a subclass of the separable permutations, 
that is to say it contains no simple permutations. (Equivalently, only nodes © and 0 appear in the 
decomposition trees.) Alternatively, this could be determined from steps 1 and 2 of the algorithmic 
chain presented in Section [3.2| 

Because C is not substitution-closed, a specihcation for C cannot be simply derived as in Section]^ 
but can be obtained as the result of our algorithm SPECIFICATION. More precisely, the hrst step 
is to call EqnForRestriction((5, {132}, 0) (which works exactly like EqnForClass on an input 
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where the last part is 0). It starts with Equation Q of Proposition 
snbstitntion closnre C of C, which rewrites in onr case as: 

C = 1 tt) ©[C+,C] tt) ©[C",C]. 

Then, we propagate into each term of this eqnation the constraint of avoiding the pattern 132, 
nsing the embeddings of 132 into © and ©. There is only one non-trivial embedding in this case, 
corresponding to 132 = ©[1,21], This resnlts in the eqnation 

C = C(132) = 1 U ©[C+(132),C(21)] U ©[C"(132),C(132)]. 


4.2 (p, 13), describing the 


Becanse this eqnation is already non-ambignons, calling the disambignation procednre DISAM¬ 
BIGUATE does not modify it (except for changing the nnion symbols U into disjoint nnion symbols 
©). This is the first eqnation of onr specihcation for C. 

This eqnation contains right-only restrictions, like C'*'(132), C(21), ... To complete the specihca¬ 
tion, Specification next compntes an eqnation for each of them, in the same fashion as above, that 
is to say rnnning EqnForRestriction followed by DISAMBIGUATE. All right-only restrictions that 
appear are processed iteratively in the same way by Specification, nntil none is left. Termination 
is gnaranteed since the nnmber of possible restrictions considered is hnite (see Section 6.4). 

The hnal resnlt of calling SPECIFICATION on C = Ai;(132) is the following specihcation: 


C = C(132) = ltt)©[C+(132),C(21)] tt)©[C“(132),C(132)] 
C+(132) = 1 tt) ©[C"(132),C(132)] 

C(21) = 1©©[C+(21),C(21)] 

C"(132) = 1 © ©[C+(132),C(21)] 

C+(21) = 1. 


An important remark is that this is exactly the resnlt prodnced by onr general method, withont 
applying any ad hoc argnment abont this specihc C. Note that this specihcation is actnally also the 
resnlt of applying AmbiguousSystem to C, which happens to be a non-ambignons system already 
in this case. 


A specihcation for C 
the proof of their 


We now tnrn to the specihcations for C = Av{132) given in |BHV08| . 
may be derived following the proofs of |BHV08) . As reminded in Section 3.1 
Lemma 2.1 shows that the set Vc = {An(12), An(21), At(132),X0,Xq} is qnery-complete, where 
(resp. Iq) is the set of ©-indecomposable (resp. ©-indecomposable) permntations. Starting from 
this qnery-complete set, the proof of their Theorem 1.1 shows that there exists a specihcation for 
C having 1 + 2“^ = 17 eqnations. To obtain this specihcation, we wonld need to compnte the sets 

3.1, which is not addressed in general in |BHV08j . 

lowever not the one presented in Example 4.3 of |BHV08) . Using ad hoc 


Ex,a dehned in Section 
This specihcation is 

argnments and constrnctions, this example shows that the set V = {An(21), At(132),X0,Xq} is 
qnery-complete. This allows to derive a specihcation for C with signihcantly fewer eqnations, namely. 


c = Cav{21),X(s,Xq W Cav{21),Xq W Cig, © Cxq 
Cav{21),Xis,Xq = 1 

Cav{21);Xq = ®[Cav{21),X(^,Xq , Cav{21),x^;Xq '±'C^^(2i),Xe] 

Cle = Q[Cav(21),Xi^,Xq W Cav{21),Xq W Cxq , Cav{21),Xis,Xq ^ Cav{21),Xq ^ Cx® ^ Cx®] 

Cxq = ©[Cx® , CA,;(21),X®,Xe W C^t;(21),Xe]- 

In the system above, for X <Z V = {Av{21),X^,Xq}, the set Cx represents permntations of C 
satisfying all properties in X and none in V' \ X. Note that the specihcation above is not exactly 
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the one that would be obtained from V applying to the letter the proof of jBHVOSl Theorem 1.1], 
which would have 1 + 2^ = 9 equations, since the empty terms like Cx^^Xq or CAv{ 2 i),x,g, have been 
removed. 

This specification has the same number of equations as the one we obtained. However, ours was 
derived as the result of a general and algorithmic method, whereas that of |BHVn8) made use of ad 
hoc arguments specific to C. 

Finally, note that in both our construction and the specification given by |BHV08[ Example 
4.3], the constraint of avoiding the pattern 21 appears because of the embedding of 132 into © 
(corresponding to 132 = ©[1, 21]), which is the only non-trivial embedding in this example. However, 
our specification and the one of |BHV08| are not the same. For example, |BHV08) has an equation 
for Cxq = C“(21) whereas we do not have an equation for this set, but for C“(132) = C~. Note that 
beyond the difference of notation, the equations of |BHVn8| and ours have a different form. For 
example, our equation for C+(132) = C"*" correspond to the equation of |BHV08| for = C'*'(21) = 
C'^ \ {1}, but since we look at a coarser level, we express this later set as Q[C~ (132), C(132)] while it 
is expressed in |BHV08| as ©[C^^(2i),Xe,Xe ^^’ Cyi^( 2 i),i©,Xe ^^^ 


7.1.2. The class C = j4t;(2413, 3142, 2143). This second example is another non-substitution-closed 
subclass of the set of separable permutations. A specification for C can again be obtained using 
our algorithm SPECIFICATION. The starting point is Equation Q of Proposition 4.2 (p 13), in 
which the 2143-avoidance constraint has been propagated by EqnForRestriction (or equivalently 
EqnForClass in this simple case). This equation is 


C = C(2143) = 1 U©[C+(2143),C(21)] U©[C+(21),C(2143)] U©[C"(2143),C(2143)], 

which is ambiguous. Indeed, the two terms ©[C+(21), C(2143)] and ©[(5'’'(2143), C(21)] have a non¬ 
empty intersection (for instance, 12 belongs to both terms). The reason for this ambiguity is the 
embedding corresponding to 2143 = ©[21,21], which has two components different from e and 1. 
(This is the only non-trivial embedding for the class C considered.) 


Calling the procedure DISAMBIGUATE on the above equation (and performing the simplifications 
of Section [6.6] ), Specification obtains the first equation of a specification for C: 

C = C(2143) = 1©©[C+(2143)(21),C(21)] ©©[C+(21),C(2143)(21)] ©©[C+(21),C(21)] 
©©[C"(2143),C(2143)]. 


Note that restrictions with pattern containment constraints, like C"*"(2143) (21), have appeared when 
running DISAMBIGUATE. The full specification is then obtained calling iteratively the procedures 
EqnForRestrigtion and Disambiguate (with simplifications) on all right-only restrictions. The 
final result produced by Spegification for C = At( 2413, 3142, 2143) is then 


C =C(2143) 

C+(2143) (21) 
C(21) 
C+(21) 
C (2143) (21) 
C-(2143) 


ll±)©[C+(2143)(21),C(21)] tt)©[C+(21),C(2143)(21)] tt)©[C+(21),C(21)] 
l±)e [C-(2143),C(2143)] 
e[C-(2143),C(2143)] 
ll±)©[C+(21),C(21)] 

1 

©[C+(2143) (21), C(21)] tt) ©[C+(21), C(2143) (21)] tt) e[C" (2143), C(2143)] 
ll±)©[C+(21),C(21)] l±)©[C+(2143)(21),C(21)] tt)©[C+(21),C(2143)(21)]. 
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This specification can again be compared with those obtained from |BHV08) . The proofs therein 
show that the set 

Vc = {Avil2),Av{21),Av{132),Av{213), Av{231),Avi312), A?;(2413), ^'(;(3142), ^r;(2143),X©,Xe} 

is query-complete, so that there exists a specification for C having 1 -|- 2® = 257 equations. 

Example 4.4 of |BHV08) however provides a specification with fewer equations. It is derived from 
the query-complete set V = {Av{21), Av{21A3>)^Xq),Xq}. There is however no hint of how this set 
was found, and especially not of a general method which would have resulted in this query-complete 
set. The specification for C that follows from this set through the proof of |BHV08l Theorem 1.1] 
would then have 1 -|- 2^ = 9 equations. Getting rid of empty terms, the specification for C obtained 
from this set which is given in |BHV08I Example 4.4] is: 

C = CAv{2i),x^,Xe W CAv{2i),Xe W W Cxq 
CAv{21),X!s,Xe = ^ 

Cav{21),Xq = ®[Cav{21),X(^,Xq , Cav{21),X^;Xq '^Cav{21);Xq\ 

Cle = Q[Cav{21),X(s,Xq W Cav{21),Xq W Cxq , Cav{21),X^,Xq W Cav{21),Xq « Cx^ W Cxq] 

Cxq = ®[Cav{21),X(s,Xq , C 13 tt) Cxq] tt) ©[Cig^ , CAv{2l),Xis,Xe '±' C.Av{21),Xq\- 

In the system above, for X <Z V' = {Av{21),X^,Xq}^ the set Cx represents permutations of C 
satisfying all properties in X and none in V' \ X. 

In this case, our specification obtained as the result of a general method has one more equation 
than the one of |BHVn8j obtained using ad hoc constructions. 

The non-substitution closed classes addressed in the examples of |BHV08] have no simple per¬ 
mutations. We now turn to the study of a more involved example. 


7.2. The class C = 74^(1243,2341,2413,41352,531642). With this third example, we apply the 
method described in this article in a more complicated case. Namely, we derive a combinatorial 
specification for the permutation class C = Av{B) where B = {1243, 2341, 2413,41352, 531642}}^ 
From this description we derive its generating function and furthermore generate at random large 
permutations of the class. We follow the different steps described in the diagram of Figure (p]10|). 

First, note that Av{B) is not substitution-closed as 1243 and 2341 are non-simple permutations 
and belong to the basis of the class. Then we test whether the class contains a finite number of 
simple permutations, and if it is the case, we compute the set Sc of simple permutations in C. In 
our case, there is only one simple permutation in C: Sq = {3142}. 

Now we have all we need to run our algorithm SPECIFICATION, or our algorithm AmbiguousSys- 
TEM if we want to compute the generating function using inclusion-exclusion. Their first step is to 
compute an equation for C. 


7.2.1. An equation for C. 

An equation for the substitution-closure C of C. An equation for the substitution closure C of C 
immediately follows from Sc- Specifically, Equation (Q of Proposition |4.2| (pfl^ is in our case: 

(17) C = 1 tt) ©[C+,C] © e[C~,C] © 3142[C,C,C,C]. 


From C to C = Av{B). Since C = C{B*) where B* denotes the non-simple permutations of B, 
the algorithm AmbiguousSystem calls EqnForClass(C, B*). Similarly, the algorithm Spegi- 
FIGATION calls EqnForRestriction(C, B*,0), which works exactly like EqnForClass(C, B*). 
Starting from Equation (17), it consists in adding the non-simple pattern avoidance constraints 
imposed by the avoidance of B. In our case, 1243 and 2341 are the only two non-simple patterns 


10- 


The reader interested in more details about this example can find them in [Piel.SI Section 3.5]. 
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in B, and we compnte an eqnation for C = C(1243, 2341) by adding these two constraints one after 
the other. 

To compnte C(1243), we propagate the constraint of avoiding 1243 into each term of Eqnation 0 
nsing the embeddings of 7 = 1243 into ©, © and 3142. This gives the following eqnation: 


(18) C(1243) = 1 U ©[C+(12),C(132)] U ©[C+(1243),C(21)] U ©[C"(1243),C(1243)] 

U 3142[C(1243),C(12),C(21),C(132)] U 3142[C(12),C(12),C(132),C(132)]. 


As explained in Section 6.6 to obtain the above eqnation, two types of simplihcations have been 
performed. First, when a nnion contains two terms snch that one is strictly inclnded in the other, 
then the smaller term has been removed (see Proposition |6.18| . Second, when two exclnded patterns 
are snch that the avoidan ce of one implies the avoidance of the other, then the larger one has been 
removed (see Proposition 6.16) - for instance we have simplihed C(1243,12) into C(12). 


Next we add the constraint of avoiding 2341 in the above eqnation as C(1243)(2341) = C(1243, 2341). 
We propagate the constraint 2341 into the 5 different terms that appear in Eqnation (18), and 
perform simplihcations as described above. The ontpnt of EqnForClass(C, i3*) or EqnFor- 
Restriction(C, H*, 0) is then: 


(19) C(1243,2341) = 1 U ©[C+(1243,2341),C(21)] U ©[C+(12), C(132,2341)] 

U ©[C“ (123), C(1243, 2341)1 U 3142[C(12), C(12), C(12), C(132, 2341)]. 


If we rnn AmbiguousSystem, this is exactly the hrst eqnation of the system. This eqnation is 
ambignons, since the intersection of ti = ©[C'’'(12),C(132, 2341)] and t 2 = ©[C^(1243, 2341),C(21)] 
is ©[C'’“(12),C(21)] which is not empty. 


Disambiguation. If we rnn SPECIFICATION, the eqnation is disambignated nsing the procednre DIS¬ 
AMBIGUATE. We can write (ti U 12 ) as {ti n t 2 ) fe) (ti n 12 ) tt) {ti n ^ 2 )- The compntation of the 
complement terms ti and t 2 (with Eqnation (15) p,27) increases the nnmber of terms in the disjoint 
nnion that describes ti U t 2 , prodncing in this case a disjoint nnion of 15 terms. After eliminating 
terms that are empty or strictly inclnded in another one, Eqnation (19) is replaced by: 


(20) C(1243,2341) = 1 tt) ©[C+(1243, 2341)(12),C(21)] tt) ©[C+(12),C(132, 2341)(21)] l±) ©[C+(12),C(21)] 

tt) e[C-(123),C(1243,2341)] tt)3142[C(12),C(12),C(12),C(132,2341)]. 


This is the hnal version of the hrst eqnation of the specihcation. 


7.2.2. The whole system. 

AmbiguousSystem. To obtain a complete system, AmbiguousSystem starts with Eqnation (19) 
compnted above. Using EqnForClass, it iterates the process of compnting eqnations for new 
classes C^{E) appearing on the right side of this eqnation, and it does it snbseqnently for any class 
appearing in one of these new eqnations. As already mentioned, this process terminates since there 
is a hnite nnmber of snbsets E of patterns of permntations of B. 
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The result of AmbiguousSystem on C is the following: 


C (1243,2341) 

C+(1243,2341) 
C(21) 
C+(12) 
C(132,2341) 
C-(123) 
C(12) 
C+(21) 
C+(132,2341) 
C" (132,123) 
C-(12) 
C(21,12) 


1 U 0[C+(1243,2341),C(21)] U 0[C+(12),C(132,2341)] 

U 0[C-(123),C(1243,2341)] U 3142[C(12),C(12),C(12),C(132,2341)] 
1 U 0[C"(123),C(1243,2341)] U 3142[C(12),C(12),C(12),C(132,2341)] 
1 U 0[C+(21),C(21)] 

1 

1 U 0[C+(132,2341),C(21)] U 0[C-(132,123),C(132,2341)] 

1 U 0[C+(12),C(12)] U 3142[C(12),C(12),C(12),C(12)] 

1 U 0[C-(12),C(12)] 

1 

1 U 0[C-(132,123),C(132,2341)] 

1 U 0[C+(12),C(21,12)] 

1 

1 . 


As noticed earlier, the first equation of the system is indeed ambiguous. This system can be used to 
compute the generating function of C using inclusion-exclusion. Since we want not only to compute 
the generating function of C, but also to generate at random uniform permutations of C, we rather 
compute a specification for C. 


Specification. The unambiguous equation for C computed by SPECIFICATION is Equation (20). As 
noticed in Section 16.31 


right-only terms, possibly involving pattern containment constraints like 
C(132, 2341)(21), appear in this equation. These terms are not dehned by our system, so we have to 
compute an equation for each of them (and iteratively so for right-only terms appearing in these new 
equations). This is done by iterating EqnForRestriction. This procedure works in a fashion 
similar to EqnForClass, except that, in addition, it propagates pattern containment constraints 
in the subtrees. For the term C(132, 2341)(21), we describe how Algorithm EqnForRestriction 
computes an additional equation. We do not give details for the other right-only terms. 

First, starting from Equation (17), we add the pattern avoidance constraints, namely 132 and 


2341, and compute an equation for C(132,2341) like before. We obtain the following equation: 


C(132,2341) = 1 U 0[C+(132,2341),C(21)] U 0[C-(132,123),C(132,2341)]. 


Then, we add the pattern containment constraints (here 21) to this equation, considering embed¬ 
dings of 21 in © and 0. The equation obtained after simplification is 

C(132,2341)(21) = ©[C+(132,2341)(21),C(21)] U e[C"(132,123),C(132, 2341)]. 

This equation is already unambiguous, so this is its hnal version. 

The process is iterated until each term that appear on the right hand side of an equation of the 
system is dehned by an unambiguous equation, which hnally leads to the following specihcation: 
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C{1243,2341) 

C+(12) 

C{132,2341)(21) 

C+{1243,2341)(12) 

C(21) 
C"{123) 
C(12) 
C{132,2341) 
C-(12) 
C+(132,2341)(21) 
C"(132,123) 
C" (123) (12) 
C(1243,2341)(12) 


C+(21) 

C+(132,2341) 

C(21,12) 


= 1 i±)©[C+(12),C(132,2341)(21)] tt)©[C+(1243,2341)(12),C(21)] tt)©[C+(12),C(21)] 

© ©[C“(123),C(1243, 2341)] ©3142[C(12),C(12),C(12),C(132, 2341)] 

= 1©©]C-(12),C(12)] 

= ©]C+(132,2341)(21),C(21)] ©©]C“(132,123),C(132, 2341)] 

= ©]C“(123)(12),C(1243,2341)(12)] W©]C“(12),C(1243,2341)(12)] 

© ©]C“(123)(12),C(12)] ©3142]C(12),C(12),C(12),C(132,2341)] 

= 1©©]C+(21),C(21)] 

= 1©©]C+(12),C(12)] ©3142]C(12),C(12),C(12),C(12)] 

= 1©©]C-(12),C(12)] 

= 1 © ©]C+(132, 2341), C(21)] © ©]C"(132,123),C(132, 2341)] 

= 1 

= ©]C”(132,123),C(132, 2341)] 

= 1©©]C+(12),C(21,12)] 

= ©]C+(12),C(12)] ©3142]C(12),C(12),C(12),C(12)] 

= ©]C+(12),C(132,2341)(21)] ©©]C+(12),C(21)] ©©]C+(1243,2341)(12),C(21)] 

© ©]C“(123)(12),C(12)] ©©[C“(12),C(1243,2341)(12)] 

© ©]C“(123)(12),C(1243,2341)(12)] ©3142]C(12),C(12),C(12),C(132,2341)] 

= 1 

= 1©©]C“(132,123),C(132, 2341)] 

= 1 . 


The above specification contains 16 equations. This should be compared to the number of equa¬ 
tions in the specification that could be derived using the general method described in the proofs 
of |BHVn 8 | and reviewed in Section 3.1 (and which would require to compute the sets Ex,a defined 


in Section 3.1). The number of equations following this method would be a priori 1 + where 
k is the number of proper patterns of permutations in B (in this case, k = 27, giving 536 870 913 
equations), although we can expect many empty terms and hence fewer equations. 


7.2.3. Byproducts of the combinatorial specification. The translation of the above specification into 
a system of equations for the generating function of C produces in this specific case a system that 
can be solved, giving access to a closed form for the generating function of C: 


(z® - 7z^ + 20z^ - 28z^ + 20^2 -7z + l)z 
~ l-9z + 32^2 - 59^3 02^4 _ 37^5 + 13^6 _ 2 ^ 7 ' 

We can also translate this specification into (Boltzmann or recursive) uniform random samplers 
of permutations in C. We have used the recursive sampleij^ so obtained to uniformly generate 
permutations in C. This is how Figure (p]ll[) was obtained, as well as Figure (pfTTj) for other 
examples of classes C. 
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this case (and in the one of Figure]^, we chose a recursive sampler over a Boltzmann one because it is more 
suitable when you want to sample many random permutations of the same medium size. 
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